No recent searches
Popular Articles
Sorry! nothing found for
Posted over 2 years ago by Sylvain Rocheleau
Using shub, I get an error message that I can't make sense of: Error: Deploy failed: b'Requirement already satisfied: setuptools in /usr/local/lib/python3.8/site-packages (from PyHamcrest>=1.9.0->Twisted>=17.9.0->scrapy>=1.0.0->scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (56.2.0)
How could "Requirement already satisfied" be the cause of an error? Here is the full log using --verbose
UserWarning: Setuptools is replacing distutils. warnings.warn("Setuptools is replacing distutils.")/usr/lib/python3/dist-packages/paramiko/transport.py:219: CryptographyDeprecationWarning: Blowfish has been deprecated "class": algorithms.Blowfish,Packing version 2f88f7d-mainDeploying to Scrapy Cloud project "592160"Login succeededBuilding an image:Step 1/12 : FROM scrapinghub/scrapinghub-stack-scrapy:2.0# Executing 5 build triggers ---> Using cache ---> Using cache ---> Using cache ---> Using cache ---> Using cache ---> 277502b8fe88Step 2/12 : ENV PYTHONUSERBASE=/app/python ---> Using cache ---> 447eed1a996dStep 3/12 : ADD eggbased-entrypoint /usr/local/sbin/ ---> Using cache ---> 5f6e9a5c319fStep 4/12 : ADD run-pipcheck /usr/local/bin/ ---> Using cache ---> 2cb387733ac4Step 5/12 : RUN chmod +x /usr/local/bin/run-pipcheck ---> Using cache ---> ef15612fd3a6Step 6/12 : RUN chmod +x /usr/local/sbin/eggbased-entrypoint && ln -sf /usr/local/sbin/eggbased-entrypoint /usr/local/sbin/start-crawl && ln -sf /usr/local/sbin/eggbased-entrypoint /usr/local/sbin/scrapy-list && ln -sf /usr/local/sbin/eggbased-entrypoint /usr/local/sbin/shub-image-info && ln -sf /usr/local/sbin/eggbased-entrypoint /usr/local/sbin/run-pipcheck ---> Using cache ---> a2ad5338b6fcStep 7/12 : ADD requirements.txt /app/requirements.txt ---> Using cache ---> 326def2c8271Step 8/12 : RUN mkdir /app/python && chown nobody:nogroup /app/python ---> Using cache ---> 0e8596a62d9cStep 9/12 : RUN sudo -u nobody -E PYTHONUSERBASE=$PYTHONUSERBASE -E PIP_NO_CACHE_DIR=0 pip install --user --no-cache-dir -r /app/requirements.txt ---> [Warning] Your kernel does not support swap limit capabilities or the cgroup is not mounted. Memory limited without swap. ---> Running in 1dfa1a19518cCollecting numpy==1.22.3 Downloading numpy-1.22.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (16.8 MB)Collecting scrapy-selenium==0.0.7 Downloading scrapy_selenium-0.0.7-py3-none-any.whl (6.7 kB)Collecting urllib3==1.25.1 Downloading urllib3-1.25.1-py2.py3-none-any.whl (150 kB)Collecting selenium>=3.9.0 Downloading selenium-4.2.0-py3-none-any.whl (983 kB)Requirement already satisfied: scrapy>=1.0.0 in /usr/local/lib/python3.8/site-packages (from scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (2.0.1)Requirement already satisfied: parsel>=1.5.0 in /usr/local/lib/python3.8/site-packages (from scrapy>=1.0.0->scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (1.6.0)Requirement already satisfied: lxml>=3.5.0 in /usr/local/lib/python3.8/site-packages (from scrapy>=1.0.0->scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (4.5.1)Requirement already satisfied: queuelib>=1.4.2 in /usr/local/lib/python3.8/site-packages (from scrapy>=1.0.0->scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (1.5.0)Requirement already satisfied: PyDispatcher>=2.0.5 in /usr/local/lib/python3.8/site-packages (from scrapy>=1.0.0->scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (2.0.5)Requirement already satisfied: Twisted>=17.9.0 in /usr/local/lib/python3.8/site-packages (from scrapy>=1.0.0->scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (19.10.0)Requirement already satisfied: zope.interface>=4.1.3 in /usr/local/lib/python3.8/site-packages (from scrapy>=1.0.0->scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (4.7.2)Requirement already satisfied: cssselect>=0.9.1 in /usr/local/lib/python3.8/site-packages (from scrapy>=1.0.0->scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (1.1.0)Requirement already satisfied: cryptography>=2.0 in /usr/local/lib/python3.8/site-packages (from scrapy>=1.0.0->scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (2.9.2)Requirement already satisfied: pyOpenSSL>=16.2.0 in /usr/local/lib/python3.8/site-packages (from scrapy>=1.0.0->scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (19.1.0)Requirement already satisfied: w3lib>=1.17.0 in /usr/local/lib/python3.8/site-packages (from scrapy>=1.0.0->scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (1.22.0)Requirement already satisfied: service-identity>=16.0.0 in /usr/local/lib/python3.8/site-packages (from scrapy>=1.0.0->scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (18.1.0)Requirement already satisfied: protego>=0.1.15 in /usr/local/lib/python3.8/site-packages (from scrapy>=1.0.0->scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (0.1.16)Requirement already satisfied: cffi!=1.11.3,>=1.8 in /usr/local/lib/python3.8/site-packages (from cryptography>=2.0->scrapy>=1.0.0->scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (1.14.0)Requirement already satisfied: six>=1.4.1 in /usr/local/lib/python3.8/site-packages (from cryptography>=2.0->scrapy>=1.0.0->scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (1.14.0)Requirement already satisfied: pycparser in /usr/local/lib/python3.8/site-packages (from cffi!=1.11.3,>=1.8->cryptography>=2.0->scrapy>=1.0.0->scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (2.20)Collecting trio~=0.17 Downloading trio-0.20.0-py3-none-any.whl (359 kB)Collecting trio-websocket~=0.9 Downloading trio_websocket-0.9.2-py3-none-any.whl (16 kB)Collecting urllib3[secure,socks]~=1.26 Downloading urllib3-1.26.9-py2.py3-none-any.whl (138 kB)Requirement already satisfied: pyasn1-modules in /usr/local/lib/python3.8/site-packages (from service-identity>=16.0.0->scrapy>=1.0.0->scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (0.2.8)Requirement already satisfied: pyasn1 in /usr/local/lib/python3.8/site-packages (from service-identity>=16.0.0->scrapy>=1.0.0->scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (0.4.8)Requirement already satisfied: attrs>=16.0.0 in /usr/local/lib/python3.8/site-packages (from service-identity>=16.0.0->scrapy>=1.0.0->scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (19.3.0)Collecting outcome Downloading outcome-1.1.0-py2.py3-none-any.whl (9.7 kB)Requirement already satisfied: idna in /usr/local/lib/python3.8/site-packages (from trio~=0.17->selenium>=3.9.0->scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (2.9)Collecting async-generator>=1.9 Downloading async_generator-1.10-py3-none-any.whl (18 kB)Collecting sortedcontainers Downloading sortedcontainers-2.4.0-py2.py3-none-any.whl (29 kB)Collecting sniffio Downloading sniffio-1.2.0-py3-none-any.whl (10 kB)Collecting wsproto>=0.14 Downloading wsproto-1.1.0-py3-none-any.whl (24 kB)Requirement already satisfied: constantly>=15.1 in /usr/local/lib/python3.8/site-packages (from Twisted>=17.9.0->scrapy>=1.0.0->scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (15.1.0)Requirement already satisfied: PyHamcrest>=1.9.0 in /usr/local/lib/python3.8/site-packages (from Twisted>=17.9.0->scrapy>=1.0.0->scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (2.0.2)Requirement already satisfied: Automat>=0.3.0 in /usr/local/lib/python3.8/site-packages (from Twisted>=17.9.0->scrapy>=1.0.0->scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (20.2.0)Requirement already satisfied: hyperlink>=17.1.1 in /usr/local/lib/python3.8/site-packages (from Twisted>=17.9.0->scrapy>=1.0.0->scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (19.0.0)Requirement already satisfied: incremental>=16.10.1 in /usr/local/lib/python3.8/site-packages (from Twisted>=17.9.0->scrapy>=1.0.0->scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (17.5.0)Collecting urllib3[secure,socks]~=1.26 Downloading urllib3-1.26.8-py2.py3-none-any.whl (138 kB) Downloading urllib3-1.26.7-py2.py3-none-any.whl (138 kB) Downloading urllib3-1.26.6-py2.py3-none-any.whl (138 kB) Downloading urllib3-1.26.5-py2.py3-none-any.whl (138 kB) Downloading urllib3-1.26.4-py2.py3-none-any.whl (153 kB) Downloading urllib3-1.26.3-py2.py3-none-any.whl (137 kB) Downloading urllib3-1.26.2-py2.py3-none-any.whl (136 kB) Downloading urllib3-1.26.1-py2.py3-none-any.whl (136 kB) Downloading urllib3-1.26.0-py2.py3-none-any.whl (136 kB)INFO: pip is looking at multiple versions of pyhamcrest to determine which version is compatible with other requirements. This could take a while.Collecting PyHamcrest>=1.9.0 Downloading PyHamcrest-2.0.3-py3-none-any.whl (51 kB) Downloading PyHamcrest-2.0.1-py3-none-any.whl (52 kB) Downloading PyHamcrest-2.0.0-py3-none-any.whl (51 kB) Downloading PyHamcrest-1.10.1-py3-none-any.whl (48 kB) Downloading PyHamcrest-1.9.0-py2.py3-none-any.whl (52 kB)Requirement already satisfied: setuptools in /usr/local/lib/python3.8/site-packages (from PyHamcrest>=1.9.0->Twisted>=17.9.0->scrapy>=1.0.0->scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (56.2.0)Deploy log location: /tmp/shub_deploy_sjufv__d.logError: Deploy failed: b'Requirement already satisfied: setuptools in /usr/local/lib/python3.8/site-packages (from PyHamcrest>=1.9.0->Twisted>=17.9.0->scrapy>=1.0.0->scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (56.2.0)'
Attachments (1)
requirements.txt52 Bytes
0 Votes
0 Comments
Login to post a comment
People who like this
This post will be deleted permanently. Are you sure?
Using shub, I get an error message that I can't make sense of:
Error: Deploy failed: b'Requirement already satisfied: setuptools in /usr/local/lib/python3.8/site-packages (from PyHamcrest>=1.9.0->Twisted>=17.9.0->scrapy>=1.0.0->scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (56.2.0)
How could "Requirement already satisfied" be the cause of an error? Here is the full log using --verbose
UserWarning: Setuptools is replacing distutils.
warnings.warn("Setuptools is replacing distutils.")
/usr/lib/python3/dist-packages/paramiko/transport.py:219: CryptographyDeprecationWarning: Blowfish has been deprecated
"class": algorithms.Blowfish,
Packing version 2f88f7d-main
Deploying to Scrapy Cloud project "592160"
Login succeeded
Building an image:
Step 1/12 : FROM scrapinghub/scrapinghub-stack-scrapy:2.0
# Executing 5 build trigger
s
---> Using cache
---> Using cache
---> Using cache
---> Using cache
---> Using cache
---> 277502b8fe88
Step 2/12 : ENV PYTHONUSERBASE=/app/python
---> Using cache
---> 447eed1a996d
Step 3/12 : ADD eggbased-entrypoint /usr/local/sbin/
---> Using cache
---> 5f6e9a5c319f
Step 4/12 : ADD run-pipcheck /usr/local/bin/
---> Using cache
---> 2cb387733ac4
Step 5/12 : RUN chmod +x /usr/local/bin/run-pipcheck
---> Using cache
---> ef15612fd3a6
Step 6/12 : RUN chmod +x /usr/local/sbin/eggbased-entrypoint && ln -sf /usr/local/sbin/eggbased-entrypoint /usr/local/sbin/start-crawl && ln -sf /usr/local/sbin/eggbased-entrypoint /usr/local/sbin/scrapy-list && ln -sf /usr/local/sbin/eggbased-entrypoint /usr/local/sbin/shub-image-info && ln -sf /usr/local/sbin/eggbased-entrypoint /usr/local/sbin/run-pipcheck
---> Using cache
---> a2ad5338b6fc
Step 7/12 : ADD requirements.txt /app/requirements.txt
---> Using cache
---> 326def2c8271
Step 8/12 : RUN mkdir /app/python && chown nobody:nogroup /app/python
---> Using cache
---> 0e8596a62d9c
Step 9/12 : RUN sudo -u nobody -E PYTHONUSERBASE=$PYTHONUSERBASE -E PIP_NO_CACHE_DIR=0 pip install --user --no-cache-dir -r /app/requirements.txt
---> [Warning] Your kernel does not support swap limit capabilities or the cgroup is not mounted. Memory limited without swap.
---> Running in 1dfa1a19518c
Collecting numpy==1.22.3
Downloading numpy-1.22.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (16.8 MB)
Collecting scrapy-selenium==0.0.7
Downloading scrapy_selenium-0.0.7-py3-none-any.whl (6.7 kB)
Collecting urllib3==1.25.1
Downloading urllib3-1.25.1-py2.py3-none-any.whl (150 kB)
Collecting selenium>=3.9.0
Downloading selenium-4.2.0-py3-none-any.whl (983 kB)
Requirement already satisfied: scrapy>=1.0.0 in /usr/local/lib/python3.8/site-packages (from scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (2.0.1)
Requirement already satisfied: parsel>=1.5.0 in /usr/local/lib/python3.8/site-packages (from scrapy>=1.0.0->scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (1.6.0)
Requirement already satisfied: lxml>=3.5.0 in /usr/local/lib/python3.8/site-packages (from scrapy>=1.0.0->scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (4.5.1)
Requirement already satisfied: queuelib>=1.4.2 in /usr/local/lib/python3.8/site-packages (from scrapy>=1.0.0->scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (1.5.0)
Requirement already satisfied: PyDispatcher>=2.0.5 in /usr/local/lib/python3.8/site-packages (from scrapy>=1.0.0->scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (2.0.5)
Requirement already satisfied: Twisted>=17.9.0 in /usr/local/lib/python3.8/site-packages (from scrapy>=1.0.0->scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (19.10.0)
Requirement already satisfied: zope.interface>=4.1.3 in /usr/local/lib/python3.8/site-packages (from scrapy>=1.0.0->scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (4.7.2)
Requirement already satisfied: cssselect>=0.9.1 in /usr/local/lib/python3.8/site-packages (from scrapy>=1.0.0->scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (1.1.0)
Requirement already satisfied: cryptography>=2.0 in /usr/local/lib/python3.8/site-packages (from scrapy>=1.0.0->scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (2.9.2)
Requirement already satisfied: pyOpenSSL>=16.2.0 in /usr/local/lib/python3.8/site-packages (from scrapy>=1.0.0->scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (19.1.0)
Requirement already satisfied: w3lib>=1.17.0 in /usr/local/lib/python3.8/site-packages (from scrapy>=1.0.0->scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (1.22.0)
Requirement already satisfied: service-identity>=16.0.0 in /usr/local/lib/python3.8/site-packages (from scrapy>=1.0.0->scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (18.1.0)
Requirement already satisfied: protego>=0.1.15 in /usr/local/lib/python3.8/site-packages (from scrapy>=1.0.0->scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (0.1.16)
Requirement already satisfied: cffi!=1.11.3,>=1.8 in /usr/local/lib/python3.8/site-packages (from cryptography>=2.0->scrapy>=1.0.0->scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (1.14.0)
Requirement already satisfied: six>=1.4.1 in /usr/local/lib/python3.8/site-packages (from cryptography>=2.0->scrapy>=1.0.0->scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (1.14.0)
Requirement already satisfied: pycparser in /usr/local/lib/python3.8/site-packages (from cffi!=1.11.3,>=1.8->cryptography>=2.0->scrapy>=1.0.0->scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (2.20)
Collecting trio~=0.17
Downloading trio-0.20.0-py3-none-any.whl (359 kB)
Collecting trio-websocket~=0.9
Downloading trio_websocket-0.9.2-py3-none-any.whl (16 kB)
Collecting urllib3[secure,socks]~=1.26
Downloading urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Requirement already satisfied: pyasn1-modules in /usr/local/lib/python3.8/site-packages (from service-identity>=16.0.0->scrapy>=1.0.0->scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (0.2.8)
Requirement already satisfied: pyasn1 in /usr/local/lib/python3.8/site-packages (from service-identity>=16.0.0->scrapy>=1.0.0->scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (0.4.8)
Requirement already satisfied: attrs>=16.0.0 in /usr/local/lib/python3.8/site-packages (from service-identity>=16.0.0->scrapy>=1.0.0->scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (19.3.0)
Collecting outcome
Downloading outcome-1.1.0-py2.py3-none-any.whl (9.7 kB)
Requirement already satisfied: idna in /usr/local/lib/python3.8/site-packages (from trio~=0.17->selenium>=3.9.0->scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (2.9)
Collecting async-generator>=1.9
Downloading async_generator-1.10-py3-none-any.whl (18 kB)
Collecting sortedcontainers
Downloading sortedcontainers-2.4.0-py2.py3-none-any.whl (29 kB)
Collecting sniffio
Downloading sniffio-1.2.0-py3-none-any.whl (10 kB)
Collecting wsproto>=0.14
Downloading wsproto-1.1.0-py3-none-any.whl (24 kB)
Requirement already satisfied: constantly>=15.1 in /usr/local/lib/python3.8/site-packages (from Twisted>=17.9.0->scrapy>=1.0.0->scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (15.1.0)
Requirement already satisfied: PyHamcrest>=1.9.0 in /usr/local/lib/python3.8/site-packages (from Twisted>=17.9.0->scrapy>=1.0.0->scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (2.0.2)
Requirement already satisfied: Automat>=0.3.0 in /usr/local/lib/python3.8/site-packages (from Twisted>=17.9.0->scrapy>=1.0.0->scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (20.2.0)
Requirement already satisfied: hyperlink>=17.1.1 in /usr/local/lib/python3.8/site-packages (from Twisted>=17.9.0->scrapy>=1.0.0->scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (19.0.0)
Requirement already satisfied: incremental>=16.10.1 in /usr/local/lib/python3.8/site-packages (from Twisted>=17.9.0->scrapy>=1.0.0->scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (17.5.0)
Collecting urllib3[secure,socks]~=1.26
Downloading urllib3-1.26.8-py2.py3-none-any.whl (138 kB)
Downloading urllib3-1.26.7-py2.py3-none-any.whl (138 kB)
Downloading urllib3-1.26.6-py2.py3-none-any.whl (138 kB)
Downloading urllib3-1.26.5-py2.py3-none-any.whl (138 kB)
Downloading urllib3-1.26.4-py2.py3-none-any.whl (153 kB)
Downloading urllib3-1.26.3-py2.py3-none-any.whl (137 kB)
Downloading urllib3-1.26.2-py2.py3-none-any.whl (136 kB)
Downloading urllib3-1.26.1-py2.py3-none-any.whl (136 kB)
Downloading urllib3-1.26.0-py2.py3-none-any.whl (136 kB)
INFO: pip is looking at multiple versions of pyhamcrest to determine which version is compatible with other requirements. This could take a while.
Collecting PyHamcrest>=1.9.0
Downloading PyHamcrest-2.0.3-py3-none-any.whl (51 kB)
Downloading PyHamcrest-2.0.1-py3-none-any.whl (52 kB)
Downloading PyHamcrest-2.0.0-py3-none-any.whl (51 kB)
Downloading PyHamcrest-1.10.1-py3-none-any.whl (48 kB)
Downloading PyHamcrest-1.9.0-py2.py3-none-any.whl (52 kB)
Requirement already satisfied: setuptools in /usr/local/lib/python3.8/site-packages (from PyHamcrest>=1.9.0->Twisted>=17.9.0->scrapy>=1.0.0->scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (56.2.0)
Deploy log location: /tmp/shub_deploy_sjufv__d.log
Error: Deploy failed: b'Requirement already satisfied: setuptools in /usr/local/lib/python3.8/site-packages (from PyHamcrest>=1.9.0->Twisted>=17.9.0->scrapy>=1.0.0->scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (56.2.0)'
Attachments (1)
requirements.txt
52 Bytes
0 Votes
0 Comments
Login to post a comment