Using "Scrapy Cloud", I would like to configure few websites and keywords against each website.
The expectation from youris that a scheduler should run and scan all websites at a regular interval [say X hours. X should be configurable from Scarpy Cloud].
Post "X" hour of crawling, your "
I followed below URL to integrate MySQL with locally installed Scrapy.
I am able to connect to MySQL but somehow data are not being pushed to MySQL table.
Attaching MySQL configurations file(s) and generated log for your reference. Could you please have a look and help us what exactly are we missing here?
In case you need any other further information(s) to troubleshoot the problem please let me know, will provide the same.
Looking forward to hearing from you guys.
Note: I am able to log extracted data to the console but not able to push that to MySQL.