Questions tagged [rds]

1

votes
1

answer
572

Views

Monitor incoming IP connections in Amazon AWS

I am using Amazon RDS and I want to know which IP addresses are connecting to my database. My security groups are set to none, and my connection is set to public, I CANT SET IT TO PRIVATE AND SPECIFY AN IP, thats not what im looking for. I just want to know if there is a way to see who is connecting...
Mario Landa
0

votes
0

answer
2

Views

web application in linux environment throws javax.ejb.ConcurrentAccessTimeoutException Unable to get read lock on singleton ejb method

I have deployed EJB web application in tomcat,linux machine. This application connects to AWS RDS through JNDI lookup that presents in @singleton ejb class. Every minute my application prints the DB content in console. In initial startup of application, DB connection is achieved once using @PostCons...
user2728146
1

votes
2

answer
176

Views

Perform any operation in Mysql once it is launched by Terraform. How can I run provisioner for RDS?

I have launched an RDS instance using terraform, now I want to create a user and DB inside it, basically, run some query inside it. So how can we achieve that? Thanks
Nikit Swaraj
0

votes
0

answer
7

Views

Some postgress connections timing-out while others don't

I have an AWS EC2 machine running a Laravel 5.2 application that connects to a Postgress 9.6 databse running in RDS. While most of the connections work, some of them are getting rejected when trying to stablish, which causes a Timeout and consequently an error in my API. I don't know what is causing...
diegopso
0

votes
0

answer
12

Views

Is there a way to have AWS RDS Public Accessibility = No but still accessible outside of EC2 instance?

For management-related reasons, I need the Public Accessibility option set to 'No' for the RDS. However, we're also looking into being able to access the RDS from our local devices. The only way we're able to do so is by selecting 'Yes' in Public Accessibility. Of course, the VPC, Gateway, Subnet, a...
ZekiraDrake
1

votes
1

answer
975

Views

Importing data from AWS Athena to RDS instance

Currently I’m listening events from AWS Kinesis and writing them to S3. Then I query them using AWS Glue and Athena. Is there a way to import that data, possibly with some transformation, to an RDS instance?
Bedi Egilmez
1

votes
1

answer
330

Views

Pipeline from AWS RDS to S3 using Glue

I was trying AWS Glue to migrate our current data pipeline from python scripts to AWS Glue . I was able to setup a crawler to pull the schema for the different postgres databases . However, I am facing issues in pulling data from Postgres RDS to S3 tables in Athena . Is there a way to directly pull...
Eshank Jain
1

votes
1

answer
41

Views

Stored procedure that accepts a query as parameter

I'm trying to write a MySQL stored procedure that accepts a SELECT query and executes it against a list of databases. Is this even possible with MySQL? Each customer in our application has their own database on the same instance. All customer databases are identical in their schema structure. Someti...
dashmug
1

votes
1

answer
20

Views

Mysql count left join strange result

Can someone help me to understand those results ? (For me all 3 should return 6455). (Using RDS mysql-8.0.13) SELECT COUNT(p.product_id) FROM product p LEFT JOIN product_attributes pa ON p.pdt_id = pa.pdt_id WHERE pa.code = 'season'; Results : 6332 SELECT COUNT(*) FROM product p; Results : 6455 SELE...
pcouaillier
1

votes
2

answer
387

Views

AWS Elastic Beanstalk: Steps to move existing RDS from db.t1.micro to db.t2.small

I'm new to AWS and having a web server environment on elastic beanstalk with EC2 (t1.micro) with RDS (db.t1.micro). Now the db.t1.micro instance is deprecated, no more new instance can be created and no support in near future. I would be helpful if anybody refers me steps to do create the t2 clone o...
Saravana
1

votes
1

answer
823

Views

Pull data from RDS MySQL db using pyspark

I am using pyspark first time. I am trying to pull data from RDS MySQL database using below code. I have referred to the following links pyspark mysql jdbc load An error occurred while calling o23.load No suitable driver, https://www.supergloo.com/fieldnotes/spark-sql-mysql-python-example-jdbc/ and...
user15051990
1

votes
1

answer
402

Views

Do I give only the read-only RDS database permission for an aws lambda code, when I create custom role and edit the policy document this way?

I want to create an aws lambda code, which provides a public API for only read from an aws rds db instance. When I want to create a lambda function, it asks me about permission roles. Because I'm afraid, I want to give a very strict permission to the code to allow only the reading from the db instan...
user190528
1

votes
0

answer
29

Views

AWS Postgres RDS Disk Spikes, randomly going down to 0

We have run out of possible answers for this, initially we thought this was due to MVCC and vacuum, but our table sizes are < 10 GB, and there are < 20 tables.
Joddy
1

votes
0

answer
342

Views

CDC change data capture start time - Postgres replication

I'm using AWS DMS for Postgres-postgres migration. For on-going replication for other engines there is a parameter CDC start time where we can specify the start time of picking up up changes for replication but unfortunately postgres does not support that parameter. By default, my assumption is when...
Ramya
1

votes
1

answer
393

Views

Error connecting to AWS RDS Oracle Service Instance

I have spun up an aws rds instance for Oracle 11g db. I have also configured VPC & Security Groups. Now I'm trying to connect to the db using sqlplus64 '[email protected](DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=dbinstancedns) (PORT=1521))(CONNECT_DATA=(SID=sidofdb)))' I'm on Ubuntu 16.04 & have set up 'SQLPl...
Ajinkya Bapat
1

votes
1

answer
319

Views

Exporting oracle table on AWS RDS that contains blobs and import into offline database

My scenario: Database 1: Oracle on Local server offline, no internet access. Database 2: Oracle RDS on AWS so no file system access to this one. I need to export a table containing blobs from the RDS instance to my offline database. I'm having trouble finding any documentation on doing this. I onl...
Richard Gutierrez
1

votes
1

answer
59

Views

Can i start my AWS RDS instance in bootstrap action of EMR creation?

I am using a RDS instance as an external hive metastore, can i start my AWS RDS instance in bootstrap action of EMR creation?
Manish Pansari
1

votes
1

answer
695

Views

Error Importing a .dmp file in AWS RDS Oracle DB

I have followed the AWS Importing Data into RDS guide. I have copied the .dmp file from Source Oracle Instance on another machine to the DATA_DUMP_DIR on RDS Instance. Now I am trying to import it using the code below: DECLARE hdnl NUMBER; BEGIN hdnl := DBMS_DATAPUMP.OPEN( operation => 'IMPORT', job...
Ajinkya Bapat
1

votes
0

answer
62

Views

Long running PSQL queries timing out randomly - cannot analyse

I have some PSQL queries running on RDS. 90% of the time these queries will run fine. However occasionally these queries will randomly timeout and not execute. I have enabled logging and auto_explain however auto_explain will only log query plans for queries that complete. If I increase the statemen...
Angelis
1

votes
1

answer
629

Views

AccessDenied: Not authorized to perform rds:DescribeDBInstances

I'd like to programmatically list my RDS database instances and cluster snapshots, so I've attached the following IAM policy directly to one of my users: { 'Version': '2012-10-17', 'Statement': [ { 'Sid': 'ReadProdSnapshotsAndInstances', 'Effect': 'Allow', 'Action': [ 'rds:DescribeDBInstances', 'rds...
Rob Johansen
1

votes
2

answer
964

Views

Granting privileges to user on AWS RDS Insance

I am currently importing a dump file inside RDS Oracle 12C instance using impdp command. Prior to that it is required to create few users & grant them required privileges. I have following statements that I use on other non-rds databases. GRANT UNLIMITED TABLESPACE TO 'USERNAME' GRANT 'RESOURCE' TO...
Ajinkya Bapat
1

votes
0

answer
39

Views

AWS architecture Account migration strategy

I will soon be asked to migrated an AWS architecture, including instances' content and DB records from one AWS account to another and I would like to hear from you all how would you define a possible strategy to tackle it: Say we have 2 AWS accounts (A1, A2). A1 was used as Proof of Concept to decid...
user3665949
1

votes
0

answer
312

Views

Aurora MySQL general_log not logging queries

I would like to log each query my Aurora MySQL is performing. In my custom Parameter group, correctly assigned to the Aurora instance, I edited the following params: general_log: 1 Once I browse the instance page, I can successfully see the 'general/mysql-general.log' entry in the log section but it...
user3665949
1

votes
0

answer
132

Views

Codeigniter 3 Sessions and RDS - Random Logouts

Can someone explain or tell me if some kind of 'setting' in Codeigniter will solve this? System : Amazon AWS EC2 (AWS Linux Centos 6.9) Database : Amazon AWS RDS (Mysql Compatible 5.6.34) Framework : Codeigniter 3.0.6 PHP : 5.6 Issue : When running my website, I have random logouts that happen after...
Forbs
1

votes
1

answer
385

Views

“Connection timed out (Connection timed out)” Error for SQLActivity

I have a connection timed out error on my data pipeline job to run a simple sql script. The script is set up in my S3. The data pipeline itself is in the region of us-east-1. My database is in us-east-2. When I first ran the pipeline I got the error 'waiting on runner' and it never ran. I figured I...
Berra2k
1

votes
1

answer
292

Views

Problems loading csv files from S3 to Aurora

i'm trying to upload a csv file from S3 to Aurora using the 'Load Data From S3' command in MySQL workbench. Keep getting the error 'S3 API returned error; missing credentials; cannot instantiate S3 client'. I'm attaching AWServiceRole for RDS to the Aurora RDS cluster - because this is the only RDS...
Jamie28
1

votes
0

answer
308

Views

Trouble Connecting Microsoft SQL Server Management Studio to Amazon RDS

I have been trying to create a new instance of SQL Server using Amazon RDS. Initially I can connect my SQL Server Management Studio to the instance but if I attempt to login in again I keep getting the error below. Is there something wrong with my settings that prevents connecting a second time? TIT...
Dima Vishnepolsky
1

votes
1

answer
242

Views

Postgres role granted but getting permission denied for relation error

I am trying to create a write-only role for a data collection endpoint. My design plan had been: create the write-only role, assign a user to that role, let the application behind the endpoint use that role I have created the role CREATE ROLE new_write_only WITH NOLOGIN NOSUPERUSER INHERIT NOCREATE...
getglad
1

votes
0

answer
166

Views

Use Alembic on GitLab to update AWS RDS instance

I am trying to set up a CI/CD pipeline in GitLab to use Alembic to automatically upgrade a Postgres instance running on AWS RDS. I am using GitLab's hosted vcs rather than having it installed on-prem, so I am unable to specifically whitelist the runner's IP in AWS. I have been looking through How t...
gwoody1984
1

votes
1

answer
293

Views

MySQL “Table doesn't exist”, but it actually does

I've set up a new RDS MySQL instance and an EC2 instance on AWS. When I run the Laravel migration, the database is set up correctly and the tables are created. I can verify this by signing in and seeing the tables in the database in the terminal. But when I try to run a signup request and create a n...
Param Singh
1

votes
0

answer
264

Views

RDS SPLA Licensing issue in Windows Server 2012 R2

I tried out the method given by Microsoft, as Install RDS client access licenses on the Remote Desktop license server But there were some issues. When I enable RDS feature, it automatically enables a Built-in open licence which has unlimited RDS sessions with 120 trial dates. Once I apply SPLA lice...
Eranda Peiris
1

votes
0

answer
79

Views

AWS EC2 RDS R Shiny - Could not find function DBI::dbFetch()

I have an AWS EC2 Ubuntu instance and an AWS RDS MySQL instance. I have connected the two so that my Ubuntu instance can interface with my MySQL database. I have tested the connection and it works. The reason I have done this is so that I can publish a Shiny app for querying my database. I have inst...
Christopher Costello
1

votes
0

answer
214

Views

Amazon AWS RDS 120GB free storage suddenly became 0GB within less than 2 hours

I've been using AWS RDS db.m4.large with 128GB storage for MySQL(InnoDB) for more than one year now. The size of my database is now less than 2GB and the free storage had always been more than 125GB as captured below but it suddenly dropped to 0GB in less than 2 hours 2 weeks ago. So I upgraded the...
PearlIsMyLove
1

votes
0

answer
22

Views

Hibernate not creating index in beta

I am using hibernate to create and manage tables. I have added a unique index constraint on a pair of column but when the table gets created the index is missing in beta. The same code when it runs in prod is creating the index and everything is working fine in prod. Why is the index not created in...
Prateek Gupta
1

votes
1

answer
177

Views

Restoring an Elastic Beanstalk RDS

When rebuilding an elastic beanstalk environment, EB automatically recreates a new and associated RDS instance. Once associated, RDS instances cannot be dissociated from an EB environment. I have a snapshot of the previous RDS prior to the rebuild. You cannot restore RDS snapshots to an existing...
Dan
1

votes
1

answer
579

Views

How to restore SQL Server .bak in Amazon RDS

Trying to restore a .bak file from S3. I have tried on SQL server express and web. Versions 2012 through 2017. I have tried with t2.micro and t2.small. Here is what my task_info says: [2018-03-21 10:20:22.107] Task execution has started. [2018-03-21 10:20:22.280] myDb.bak: Completed processing 17.27...
gotmike
1

votes
0

answer
267

Views

Kubernetes DNS resolving troubles with Amazon RDS hosts

I have an Flask + SQLAlchemy deployed in Kubernetes, using Amazon AWS as cloud provider (Amazon EC2 machines) with a PostgreSQL RDS. Sometimes an excetion arises when a request is performed: psycopg2.OperationalError: could not translate host name 'xxx.yyy.eu-west-1.rds.amazonaws.com' to address: Na...
Joan Font
1

votes
0

answer
202

Views

PHP Warning: mysqli_query(): Premature end of data (mysqlnd_wireprotocol.c:967)

Running into a strange error running a MySQL query with php: PHP Warning: mysqli_query(): Premature end of data (mysqlnd_wireprotocol.c:967) in /ours/scripts/update-trending.php on line 97 PHP Warning: mysqli_query(): EOF packet 1 bytes shorter than expected in /ours/scripts/update-trending.php on...
Richard Zack
1

votes
0

answer
421

Views

How to use Terraform to execute SQL script on RDS MySQL?

I created the aws_db_instance to provision the RDS MySQL database using Terraform configuration. Now my next question is to execute the SQL Script (CREATE TABLE and INSERT statements) on the RDS. I did the following but there is no effect. terraform plan cannot even see my changes on executing the s...
Julie
1

votes
0

answer
237

Views

Change character set for aws rds without restart

I am trying to change the character set for AWS RDS mysql instance. By default, the character sets are as following +--------------------------+-----------------------------------------------+ | Variable_name | Value | +--------------------------+--...
laocius

View additional questions