No recent searches
Popular Articles
Sorry! nothing found for
Posted over 4 years ago by Lilu Cao
Is any config there for crawlera to allow download large files(>100M)?
thanks so much
0 Votes
nestor posted over 4 years ago Admin Best Answer
There is no specific config for this. The file size limit is 500MB, anything higher will return a 541 error code, see: https://doc.scrapinghub.com/crawlera-errors.html#failure-errors-server-side
1 Comments
nestor posted over 4 years ago Admin Answer
Login to post a comment
People who like this
This post will be deleted permanently. Are you sure?
Is any config there for crawlera to allow download large files(>100M)?
thanks so much
0 Votes
nestor posted over 4 years ago Admin Best Answer
There is no specific config for this. The file size limit is 500MB, anything higher will return a 541 error code, see: https://doc.scrapinghub.com/crawlera-errors.html#failure-errors-server-side
0 Votes
1 Comments
nestor posted over 4 years ago Admin Answer
There is no specific config for this. The file size limit is 500MB, anything higher will return a 541 error code, see: https://doc.scrapinghub.com/crawlera-errors.html#failure-errors-server-side
0 Votes
Login to post a comment