Exporting scraped items to an AWS/S3 account (UI mode)

Modified on Wed, 3 Feb, 2021 at 11:38 AM

In order to store your items in an S3 account provided by AWS, you need to enable certain Scrapy settings in Scrapy Cloud.


First, go to your Spider settings and select these fields, using your credentials provided by AWS:



Once your job is finished, you can check the log to see if items were delivered:




If you cancel your job before it's finished, delivery won't be made to the S3. 


For more information on Feed Exports, see: https://doc.scrapy.org/en/latest/topics/feed-exports.html

Was this article helpful?

That’s Great!

Thank you for your feedback

Sorry! We couldn't be helpful

Thank you for your feedback

Let us know how can we improve this article!

Select at least one of the reasons
CAPTCHA verification is required.

Feedback sent

We appreciate your effort and will try to fix the article