I am rather new to Scrapinghub and have a question. I made spider to crawl some data from a website. When I run this spider locally, it extracts items, but as soon as I deploy it, it doesn't. Any idea what could be going wrong? There are no errors showing up in the logs in the Scrapinghub job dashboard. Also, I wanted to add some debug logging to the code I have written in Python. I imported the logging package and then used logging.debug(""), but these logs dont show up on the Scrapinghub job dashboard either.
Hello,
I am rather new to Scrapinghub and have a question. I made spider to crawl some data from a website. When I run this spider locally, it extracts items, but as soon as I deploy it, it doesn't. Any idea what could be going wrong? There are no errors showing up in the logs in the Scrapinghub job dashboard. Also, I wanted to add some debug logging to the code I have written in Python. I imported the logging package and then used logging.debug(""), but these logs dont show up on the Scrapinghub job dashboard either.
Can anybody help me please?
Thank you!
0 Votes
0 Comments
Login to post a comment