Start a new topic

Scrapy complains about missing botocore library when uploading data to S3 bucket

I have already installed botocore library

>> pip freeze




But when I tried to update data to s3, I still got this error message:

2021-09-16 14:11:32 [scrapy.utils.log] INFO: Scrapy 2.5.0 started




2021-09-16 14:11:32 [scrapy.extensions.feedexport] ERROR: Disabled feed storage scheme: s3. Reason: missing botocore library

My setting files looks like:

AWS_ACCESS_KEY_ID = 'my access key id'

AWS_SECRET_ACCESS_KEY= 'my secrete access key'



'scrapy.pipelines.files.S3FilesStore': 1


Any idea why the upload failed?




Login to post a comment