Boto3

Posted over 6 years ago by Yingke Yu

Post a topic

Answered

Yingke Yu

Hi I try to set up my script wiht boto3 to scrapinghub cloud, in deploy it does not work, I encounter some version error for pip install.

How can I solve it?

0 Votes

Yingke Yu posted over 6 years ago Best Answer

Oh not really, but I figured things out here, I put

botocore==1.5.8

boto3==1.4.4

and it works fine now.

Thanks a lot for your help!

1 Votes

9 Comments

Yingke Yu posted over 6 years ago Answer

Oh not really, but I figured things out here, I put

botocore==1.5.8

boto3==1.4.4

and it works fine now.

Thanks a lot for your help!

1 Votes

jwaterschoot posted over 6 years ago

I assumed you use boto and aws to upload your scraped items to S3.

0 Votes

Yingke Yu posted over 6 years ago

upload to S3? sorry you mean shub deploy?

0 Votes

jwaterschoot posted over 6 years ago

Sorry that was an example. From the screen shot you sent you want

awscli==1.11.45

botocore==1.5.8

s3transfer==0.1.9

What is the code you use to upload to S3?

0 Votes

Yingke Yu posted over 6 years ago

it says Could not find a version that satisfies the requirement boto3==10.0.0

0 Votes

jwaterschoot posted over 6 years ago

You can add versions to the `requirements.txt` with boto3==10.0.0, does that help?

0 Votes

Yingke Yu posted over 6 years ago

0 Votes

Yingke Yu posted over 6 years ago

No I just put boto3 in it, how could I know what version I should use for boto3?

0 Votes

jwaterschoot posted over 6 years ago

Can you show the requirements file? Did you hardcode the versions in the requirements.txt?

0 Votes