Questions tagged [amazon-web-services]
28872 questions
1
votes
1
answer
572
Views
Monitor incoming IP connections in Amazon AWS
I am using Amazon RDS and I want to know which IP addresses are connecting to my database. My security groups are set to none, and my connection is set to public, I CANT SET IT TO PRIVATE AND SPECIFY AN IP, thats not what im looking for. I just want to know if there is a way to see who is connecting...
1
votes
2
answer
2.2k
Views
What does “!Sub |” mean in AWS UserData field with YAML syntax?
In this example from AWS docs we have a UserData field that allows a multiline string, using the following syntax:
UserData:
Fn::Base64: !Sub |
#!/bin/bash -xe
yum update -y aws-cfn-bootstrap
/opt/aws/bin/cfn-init -v --stack ${AWS::StackName} --resource LaunchConfig --region ${AWS::Region}
/opt/aws/...
1
votes
1
answer
798
Views
stopping duplicate entry in dynamodb
I have a table called followProduct in Dynamodb and it has following strucure
id - item id
email - user email
product - product id
Whenever a user follows a product I am making an entry in the table. I am trying to stop duplicate entry and using the following code
let params = {
TableName: 'followPr...
1
votes
1
answer
1.3k
Views
aws: error: argument command: Invalid choice, valid choices are: this is the error showing with some number of commands
aws rekognition index-faces \
--image '{'S3Object':{'Bucket':'mybucketname','Name':'S3ObjectKey'}}' \
--collection-id 'image1' \
--region us-east-1 \
--profile adminuser
That is my code which I'm running on terminal, I tried but don't know why is that error coming. What changes should I do??
1
votes
2
answer
1.3k
Views
AWS Lambda boto3: Filter Instances by Launch Time = today
I'm trying to automatically backup my EC2 instances through AWS Lambda.
I used these 2 scripts and they work just fine.
https://gist.github.com/bkozora/724e01903a9ad481d21e
https://gist.github.com/bkozora/d4f1cf0e5cf26acdd377
But I would like to add the functionality that the scripts only delete or...
1
votes
2
answer
334
Views
get the Alarm object of CloudWatch using boto 2
I created an alarm and want to delete it afterward...
The documentation for boto 2 doesn't show how to do that.
Any help ?
Thanks
1
votes
1
answer
169
Views
Neo4j on Amazon Marketplace: Unauthorized with default credentials
I just deployed Neo4J from Amazon Marketplace on Amazon ECS
I can browse to the GUI but the default credentials (neo4j/neo4j) seems to not work.
The error message reads:
Neo.ClientError.Security.Unauthorized: The client is unauthorized due to authentication failure.
What am I missing?
1
votes
1
answer
416
Views
How to specfiy existing FunctionName on SAM Template
I'm trying to deploy AWS Lambda function by using SAM.
What I want to do is to update exsiting lambda function by deploying local source code.
In order to do that, I specified the existing lambda function name as 'FunctionName' in template.yaml like below.
However, 'FunctionName' does only support f...
1
votes
2
answer
1.1k
Views
Load Testing AWS API Gateway
As the question suggests, I need to perform Load Test on the API Gateway Resources with 1 million RPS. Apache JMeter is a very good tool for Load Testing. But I think it won't be possible to simulate such a huge load from a single machine. In that case, JMeter Clusters could be useful. But setting i...
1
votes
2
answer
6.2k
Views
Aws Ec2 run script program at startup
There is a method to setup an EC2 machine to execute Kafka starting script on startup?
I use also java Aws SDK, so I accept both solution for a program java that run command on EC2 instance and solutions for a bash script mode that run kafka script at startup.
1
votes
2
answer
176
Views
Perform any operation in Mysql once it is launched by Terraform. How can I run provisioner for RDS?
I have launched an RDS instance using terraform, now I want to create a user and DB inside it, basically, run some query inside it. So how can we achieve that?
Thanks
1
votes
1
answer
412
Views
Host Dockerized Django project on AWS
I have a Django project which is working fine on my local machine. I want to host the same on AWS, but confused on what service to use and what is the best practice to so. Do I use EC2, create a ubuntu instance on it and install Docker or use ECS ?
What is the best practice to transfer my django pro...
1
votes
2
answer
1.4k
Views
Downgrade to previous version of AWS Lambda
Working with Amazon Lambda functions I use versioning feature which is provided by AWS Lambda functionality. Each time when I deployed new version of my artifact to AWS I create new version of function and publish it (using popup from screenshot).
But how can I publish any previous version of my fun...
0
votes
0
answer
5
Views
Data loss after upgrading instance type in AWS EC2
I upgraded an AWS EC2 machine 10 days ago (from t2-medium to t2-large). Again, I just upgraded today the same AWS EC2 machine (from t2-large to t2-xlarge) and after rebooting I noticed a massive loss of data (10 days of work). In fact, after changing instance type I found out it reverted to the same...
1
votes
1
answer
524
Views
AWS CLI command for querying S3 bucket
I have a bucket which I will call some-images for showing here. I am trying to get my command to return all objects that have a key value which starts_with a number. Here is the code I am using:
cmd = 'aws s3api list-objects --bucket some-images --query \'Contents[?starts_with(Key, '10000'\''
push =...
1
votes
1
answer
461
Views
AWS Amplify Push Notifications with React Native
There seem to be some discrepancies in the documentation as to how to implement Push Notifications. Here is the RN code from the AWS Amplify docs:
import { PushNotificationIOS } from 'react-native';
import Analytics from '@aws-amplify/analytics';
import PushNotification from '@aws-amplify/pushnotifi...
1
votes
1
answer
760
Views
AWS Sagemaker unable to parse csv
I'm trying to run a training job on AWS Sagemaker, but it keeps failing giving the following error:
ClientError: Unable to parse csv: rows 1-5000, file /opt/ml/input/data/train/KMeans_data.csv
I've selected 'text/csv' as the content type and my CSV file contains 5 columns with numerical content and...
1
votes
1
answer
198
Views
AWS CodePipeline Notifications
I am trying to add some notifications to my Pipeline in AWS.
I have a build stage where I use AWS CodeBuild and I want to receive an email whenever the build fails.
I have followed the tutorial that amazon offers and it works fine to notify me about the failure, but I can't seem to find how to ad...
1
votes
1
answer
489
Views
What TCP port number does the aws cli s3 use?
When you upload or download files via aws cli, what TCP port number does it use over the internet?
1
votes
1
answer
502
Views
Can I use an Elastic IP with Cloudfront in AWS?
We want to use Cloudfront in our AWS infrastructure. The question is if is it possible to have the same Elastic IP that we use now in an EC2 instance. Or do we have to switch to Cloudfront IPs?
1
votes
1
answer
346
Views
Using Ref for Resource in Step function inside cloudformation template
I have a step function inside cloudformation. The cloudformation stack also create Lambdas which i will use as resource in step function. I have something like
TestLambda:
Type: 'AWS::Lambda::Function'
Properties:
Handler: 'test_lambda.lambda_handler'
Role: 'arn:aws:iam::1234342334:role/Lambda'
Code...
1
votes
2
answer
101
Views
get all secrets from AWS secret manager
AWS has secret manager which stores secrets. It has the API to get individual secret. I want to fetch all the secrets related to an account at once. Any way we can achieve this?
1
votes
2
answer
3.3k
Views
Terraform aws: Error No configuration files found
I am new to Terraform. I am writing a small script to put a small datafile from my machine to aws S3 bucket.. but I am getting below error.
Terraform file code:-
provider 'aws' {
region = 'us-east-1'
version = '~> 1.6'
}
terraform {
backend 's3' {
bucket = '${var.bucket_testing}'
kms_key_id =...
1
votes
1
answer
925
Views
Terraform AWS S3 to Lambda Notification Trigger
I am trying to codify lambda function to be triggered using S3. Creation of Lambda function is successful, but the 'aws_s3_bucket_notification' resource fails at terraform:apply with MethodNotAllowed error with status code 405 :
Error: Error applying plan:
20-Sep-2018 15:23:53 1 error(s) occurred...
1
votes
1
answer
87
Views
AWS elastic IP vs public IP
I am new to AWS and tried to create an EC2 instance.
I have a domain and ready to modify the A record to the associated EC2 instance.
I found an article that said an elastic IP is required for associating a production domain.
But AWS provides a public IP and it is accessible on the public internet t...
1
votes
1
answer
484
Views
How to pass script arguments to AWS Batch fetch-and-run
I am following this tutorial to run a simple fetch-and-run example in AWS batch. However, I'm unable to pass arguments to the script fetched through this example.
The basic example will produce this execution:
export BATCH_FILE_TYPE='script'
export BATCH_FILE_S3_URL='s3://my-bucket/my-script'
fetch_...
1
votes
2
answer
61
Views
How do I manage multiple clients on AWS? [on hold]
I am new to Amazon AWS and as a freelancer I am not clear on how I would facilitate dozens of clients using AWS. I average 5 clients per month. How would I do billing and set up instances for multiple clients? I have been using godaddy for a long time and they have a pro user dashboard that manages...
1
votes
1
answer
457
Views
AWS ECS Fargate pull image from a cross account ECR repo
I have 2 AWS accounts:
- account A that has an ECR repo.
- account b that has an ECS cluster running Fargate.
I have created a 'cross-account' role in account A with trust relations to account B, also I have attached the 'AmazonEC2ContainerRegistryPowerUser' policy to this role.
I gave access to th...
1
votes
2
answer
339
Views
AWS Glue: Do I really need a Crawler for new content?
What I understand from the AWS Glue docs is a craweler will help crawl and discover new data. However, I noticed that once I crawled once, if new data goes into S3, the data is actually already discovered when I query the data catalog from Athena for example. So, can I say I do not need a crawler to...
1
votes
1
answer
530
Views
How to use importValue and join in Cloudformation
I have a stack which depends on a value which is exported in a different stack (value is supertest)
I try to use it as below
OriginAccessIdentity: !Join [ '', [ 'origin-access-identity/cloudfront/', !ImportValue: !Sub 'supertest-${Environment}' ] ]
But I got a syntax error while this works (hardcodi...
1
votes
1
answer
172
Views
AWS CloudWatch GetMetricsData: “Sum” misses points on periods without values
I am querying GetMetricsData from AWS CloudWatch:
{
StartTime: lastWeek ,
EndTime: today,
MetricDataQueries: [
{
Id: 'invocations',
Label: 'Invocations',
MetricStat: {
Metric: {
Dimensions: [
{
Name: 'FunctionName',
Value: /* FunctionName */,
},
],
MetricName: 'Invocations',
Namespace: 'AWS/Lambda'...
1
votes
1
answer
330
Views
How to use AWS CLI with Digital Ocean Spaces?
How to use AWS CLI with Digital Ocean Spaces? Is it possible?
I tried to add my key id and secret to .aws/credentials but I got:
An error occurred (InvalidAccessKeyId) when calling the ListBuckets
operation: The AWS Access Key Id you provided does not exist in our
record
1
votes
2
answer
156
Views
Insufficient cpu in Kubernetes multi node cluster
I am trying to deploy an application into my Kubernetes cluster. It is a multi node cluster. There are 3 m4.2xlrge aws instances.
m4.2xlarge
vCPU :- 8
Memory :- 32
Now, in my deployment.yaml file for that service, I have mentioned
limit:
cpu: 11
request:
cpu: 11
It is giving error, insufficient cpu...
1
votes
1
answer
118
Views
Node ImageMagick succeed locally but fails in AWS Lambda
I'm using this Node ImageMagick for validating images via converting them in AWS Lambda function. Locally I have no problem, but when I deploy my function I get the error no decode delegate for this image format on some images only:
{ Error: Command failed: convert: no decode delegate for this image...
1
votes
2
answer
455
Views
kubernetes not creating the ELB for ingress-nginx controller
I am trying to set up ingress-nginx-controller with type as LoadBalancer
using this guide for the configuration.
Couple of issues I'm observing -
issue#1) It does not create and deploy a ELB onto the AWS.
issue#2) The External-IP status is showing as pending for ever.
$ kubectl get services -...
1
votes
4
answer
590
Views
AWS API Gateway Websockets — where is the connectionID?
I am setting up an AWS API Gateway Websockets with a custom authorizer on the $connect route, as described here:
https://docs.aws.amazon.com/apigateway/latest/developerguide/apigateway-websocket-api-route-keys-connect-disconnect.html
My question is -- how do I get the connectionID, ie the identifier...
1
votes
1
answer
136
Views
How to make AWS REST API return a JSON instead of XML
In AWS I invoke the call ListQueues on sqs.us-east-2.amazonaws.com (by calling directly to the REST API)
The response is always an XML, and searching in the AWS documentation I couldn't find how to get a JSON.
Any ideas?
0
votes
0
answer
5
Views
Creating an page on web app where an admin can confirm users in AWS Userpool
I'm currently building out a server-less web application on AWS that allows end users to register for accounts.
My registration process (to create users) is making use of aws-amplify for JavaScript to send requests to AWS Cognito from the front-end. There is absolutely no custom backend I'm running...
1
votes
2
answer
48
Views
SQS Queues/ Visibility Timeouts/ message groups
I am new to AWS. I am trying to understand SQS here. I have gone over a few trainings also but I still could not get some answers there in the discussion forum. I am re-iterating my question here. Note that I know that a few questions below have obvious answers and are therefore more of a rhetoric....
1
votes
2
answer
43
Views
Access AWS services from Apache Nifi running on AWS
I have a Nifi instance running on an EC2 machine and I am trying to access a restricted s3 bucket. Because generating access keys manually is not recommended, I want to give the machine the proper IAM role for accessing the outside bucket.
I gave the EC2 machine a role which seems to work for every...