Connection to the other side was lost in a non-clean fashion

Posted over 7 years ago by Artem M

Post a topic

Answered

Artem M

The same excat project runs locally like a charm.

When deployed to SH i am getting [scrapy.core.scraper] Error downloading <GET http://www.guatecompras.gt/proveedores/consultaDetProvee.aspx?rqp=10&lprv=1>: [<twisted.python.failure.Failure twisted.internet.error.ConnectionLost: Connection to the other side was lost in a non-clean fashion.>] from start.

My settings are -

[scrapy.utils.log] Overridden settings: {'NEWSPIDER_MODULE': 'shupload.spiders', 'LOG_LEVEL': 'INFO', 'SPIDER_MODULES': ['shupload.spiders'], 'STATS_CLASS': 'sh_scrapy.stats.HubStorageStatsCollector', 'LOG_ENABLED': False, 'MEMUSAGE_LIMIT_MB': 950, 'TELNETCONSOLE_HOST': '0.0.0.0', 'BOT_NAME': 'shupload', 'MEMUSAGE_ENABLED': True, 'USER_AGENT': 'Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/65.0.3325.181 Safari/537.36'}

Any thoughts?

0 Votes

nestor posted over 7 years ago Admin Best Answer

I can't open that website, they probably block access to certain countries. You might need a proxy service like Crawlera to access this website, unless they allow access only from Guatemala, because we don't have proxies from Guatemala.

0 Votes

1 Comments

nestor posted over 7 years ago Admin Answer

0 Votes