Cannot connect to MySQL on RDS

Posted over 6 years ago by raheel masood

Post a topic

Answered

raheel masood

Firstly thanks for the amazing product for managing our scrapy project.

I am trying to run my spider on scrapy cloud which has a pipeline that stores the scraped items to a database which is hosted on Amazon RDS.

I am always getting the following error

(2003, "Can't connect to MySQL server on 'abcproject.foobar.ap-southeast-1.rds.amazonaws.com' (timed out)")

The same project when i run on my machine it works fine.

I want to know what why that connection is not getting through and what I can do in order to run my spiders successfully.

Thanks

0 Votes

nestor posted over 6 years ago Admin Best Answer

Checked with our platform team and we can't connect to your RDS. It can't connect from our Scrapy Cloud servers nor anywhere else. So I would suggest you revise your policy settings.

0 Votes

11 Comments

nestor posted over 6 years ago Admin

Is mysql port 3306 opened for external connections? It's likely that you've whitelisted only your IP.

0 Votes

raheel masood posted over 6 years ago

Hi,

No I haven't listed any IP. I have the public policy for my RDS as long as someone have my db user and password

0 Votes

raheel masood posted over 6 years ago

I wonder who have accepted this as a answer. This is not the white listing or port open problem

0 Votes

nestor posted over 6 years ago Admin

I did and you can remove the answered flag if the answer does not solve your issue. I will check with our platform team if there's any issues connecting from our nodes to your server.

1 Votes

raheel masood posted over 6 years ago

Okay Thank you so much

0 Votes

nestor posted over 6 years ago Admin Answer

Checked with our platform team and we can't connect to your RDS. It can't connect from our Scrapy Cloud servers nor anywhere else. So I would suggest you revise your policy settings.

0 Votes

raheel masood posted over 6 years ago

Which RDS your team tried to connect ?

The one in my question or the one in my code ?

Thanks

0 Votes

raheel masood posted over 6 years ago

Ok Got it ... I found the issue in AWS. Thanks for helping.

0 Votes

nestor posted over 6 years ago Admin

The one in your code, but I'm glad you found the issue.

0 Votes

Artem M posted over 6 years ago

So what was the issue and how did you fix it?

0 Votes

raheel masood posted over 6 years ago

The inbound rules were restricted. I then allowed connections from any source to my MySQL instance.

0 Votes