No recent searches
Popular Articles
Sorry! nothing found for
Posted about 6 years ago by aserhii
CRAWLERA_APIKEY = "KEY"
CRAWLERA_PRESERVE_DELAY = 3
CONCURRENT_REQUESTS = 10
CONCURRENT_REQUESTS_PER_DOMAIN = 10
AUTOTHROTTLE_ENABLED = False
DOWNLOAD_TIMEOUT = 600
Hello everyone.Tell me please what I need to change in these settings because I see `429` error in my terminal, I use C10 plan.
Thank you very much.
0 Votes
nestor posted about 6 years ago Admin Best Answer
It's fine except for CRAWLERA_PRESERVE_DELAY which is a True or False setting: https://scrapy-crawlera.readthedocs.io/en/latest/settings.html#crawlera-preserve-delay
3 Comments
nestor posted about 6 years ago Admin Answer
aserhii posted about 6 years ago
nestor posted about 6 years ago Admin
Which account are you using? From what I can see your Crawlera account is suspended.
Login to post a comment
People who like this
This post will be deleted permanently. Are you sure?
CRAWLERA_APIKEY = "KEY"
CRAWLERA_PRESERVE_DELAY = 3
CONCURRENT_REQUESTS = 10
CONCURRENT_REQUESTS_PER_DOMAIN = 10
AUTOTHROTTLE_ENABLED = False
DOWNLOAD_TIMEOUT = 600
Hello everyone.
Tell me please what I need to change in these settings because I see `429` error in my terminal, I use C10 plan.
Thank you very much.
0 Votes
nestor posted about 6 years ago Admin Best Answer
It's fine except for CRAWLERA_PRESERVE_DELAY which is a True or False setting: https://scrapy-crawlera.readthedocs.io/en/latest/settings.html#crawlera-preserve-delay
0 Votes
3 Comments
nestor posted about 6 years ago Admin Answer
It's fine except for CRAWLERA_PRESERVE_DELAY which is a True or False setting: https://scrapy-crawlera.readthedocs.io/en/latest/settings.html#crawlera-preserve-delay
0 Votes
aserhii posted about 6 years ago
0 Votes
nestor posted about 6 years ago Admin
Which account are you using? From what I can see your Crawlera account is suspended.
0 Votes
Login to post a comment