Learn all about the latest trends and best practices in data extraction - Join us at Extract SummitGet tickets
Start a new topic

Spider works locally, but not on scrapinghub

I'm running a very simple spider that sends two POST requests. (code attached) 

On my home computer it works just fine, but on scrapinghub I get the same error for each request sent:


``

[scrapy.core.scraper] Error downloading <POST https://baca.ii.uj.edu.pl/p12018/testerka_gwt/problems>: [<twisted.python.failure.Failure OpenSSL.SSL.Error: [('SSL routines', 'SSL23_GET_SERVER_HELLO', 'tlsv1 alert internal error')]>]


``

After that, the spider stops, there is no data collected.


I think it has to do with the site's certificate being outdated, but in the docs it says that Scrapy doesn't check that.


Any ideas?

Thanks



py
(1.1 KB)

Sorry for late reply. Will try that, thank you.

Login to post a comment