I have a spider and I have a function the utilizes Pandas to create a link query. I tried uploading the spider to scrapinghub and I needed a requirements.txt folder so I made it.
pandas==0.24.2
And in scrapinghub.yml
project: xxxxxx
requirements:
file: [pathName]
after trying to deploy on scrapinghub, using shub deploy in the same directory as my spider:
Building wheels for collected packages: pandas
Building wheel for pandas (setup.py): started
Building wheel for pandas (setup.py): still running...
Building wheel for pandas (setup.py): still running...
Building wheel for pandas (setup.py): still running...
Deploy log location: /var/folders/st/_5np1sr92zl_34jy58rt65c40000gn/T/shub_deploy_cm7i1gzp.log
Error: Deploy failed: b' Building wheel for pandas (setup.py): still running...'
I think the requirements file is fine because in terminal I had:
I have a spider and I have a function the utilizes Pandas to create a link query. I tried uploading the spider to scrapinghub and I needed a requirements.txt folder so I made it.
And in scrapinghub.yml
after trying to deploy on scrapinghub, using shub deploy in the same directory as my spider:
I think the requirements file is fine because in terminal I had:
2 Votes
0 Comments
Login to post a comment