How can we help you today?

Start a new topic
Discussions Scrapy Cloud Technical Help
Answered

Cannot connect to MySQL on RDS

Hi


Firstly thanks for the amazing product for managing our scrapy project.


I am trying to run my spider on scrapy cloud which has a pipeline that stores the scraped items to a database which is hosted on Amazon RDS.


I am always getting the following error 


 

(2003, "Can't connect to MySQL server on 'abcproject.foobar.ap-southeast-1.rds.amazonaws.com' (timed out)")

 


The same project when i run on my machine it works fine.


I want to know what why that connection is not getting through and what I can do in order to run my spiders successfully.


Thanks

Best Answer

Checked with our platform team and we can't connect to your RDS. It can't connect from our Scrapy Cloud servers nor anywhere else. So I would suggest you revise your policy settings.

11 CommentsSorted by Newest First

The inbound rules were restricted. I then allowed connections from any source to my MySQL instance.

So what was the issue and how did you fix it?

The one in your code, but I'm glad you found the issue.

Ok Got it ... I found the issue in AWS. Thanks for helping.

Which RDS your team tried to connect ?


The one in my question or the one in my code ? 


Thanks


Answer

Checked with our platform team and we can't connect to your RDS. It can't connect from our Scrapy Cloud servers nor anywhere else. So I would suggest you revise your policy settings.

Okay Thank you so much

I did and you can remove the answered flag if the answer does not solve your issue. I will check with our platform team if there's any issues connecting from our nodes to your server.

1 person likes this

I wonder who have accepted this as a answer. This is not the white listing or port open problem

Hi,


No I haven't listed any IP. I have the public policy for my RDS as long as someone have my db user and password

Is mysql port 3306 opened for external connections? It's likely that you've whitelisted only your IP.

Login to post a comment
More topics in Technical Help
See all 453 topics