Learn all about the latest trends and best practices in data extraction - Join us at Extract SummitGet tickets
Start a new topic

CRAWLERA_ENABLED in custom_settings ignored by Scrapy Cloud

Subj. If I add 

custom_settings = {CRAWLERA_ENABLED': True}

 while deactivated Crawlera in Spiders -> Settings, spider doesn't use Crawlera. And vice versa, if Crawlera enabled in Spiders -> Settings and spider has

custom_settings = {CRAWLERA_ENABLED': False}

 it always use Crawlera ignoring explicit custom settings.


Is it even possible to set Crawlera usage on spider basis within same project on Scrapy Cloud platform?

Login to post a comment