No recent searches
Popular Articles
Sorry! nothing found for
Posted over 6 years ago by madhulika
How to disable auto-throttle in crawlera?
0 Votes
thriveni posted over 6 years ago Admin Best Answer
You can disable Auto-throttle through following ways:
1. By Customizing Scrapy settings through UI as given in https://support.scrapinghub.com/a/solutions/articles/22000200670-customizing-scrapy-settings-in-scrapy-cloud. UI settings have precendence over the settings.py of the spider.
2. Through the settings.py (AUTOTHROTTLE_ENABLED = False) as given in https://support.scrapinghub.com/a/solutions/articles/22000188399-using-crawlera-with-scrapy
1 Comments
thriveni posted over 6 years ago Admin Answer
Login to post a comment
People who like this
This post will be deleted permanently. Are you sure?
How to disable auto-throttle in crawlera?
0 Votes
thriveni posted over 6 years ago Admin Best Answer
You can disable Auto-throttle through following ways:
1. By Customizing Scrapy settings through UI as given in https://support.scrapinghub.com/a/solutions/articles/22000200670-customizing-scrapy-settings-in-scrapy-cloud. UI settings have precendence over the settings.py of the spider.
2. Through the settings.py (AUTOTHROTTLE_ENABLED = False) as given in https://support.scrapinghub.com/a/solutions/articles/22000188399-using-crawlera-with-scrapy
0 Votes
1 Comments
thriveni posted over 6 years ago Admin Answer
You can disable Auto-throttle through following ways:
1. By Customizing Scrapy settings through UI as given in https://support.scrapinghub.com/a/solutions/articles/22000200670-customizing-scrapy-settings-in-scrapy-cloud. UI settings have precendence over the settings.py of the spider.
2. Through the settings.py (AUTOTHROTTLE_ENABLED = False) as given in https://support.scrapinghub.com/a/solutions/articles/22000188399-using-crawlera-with-scrapy
0 Votes
Login to post a comment