Zyte Support Center

 Using shub, I get an error message that I can't make sense of:

Error: Deploy failed: b'Requirement already satisfied: setuptools in /usr/local/lib/python3.8/site-packages (from PyHamcrest>=1.9.0->Twisted>=17.9.0->scrapy>=1.0.0->scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (56.2.0)

How could "Requirement already satisfied" be the cause of an error? Here is the full log using --verbose

UserWarning: Setuptools is replacing distutils.
  warnings.warn("Setuptools is replacing distutils.")
/usr/lib/python3/dist-packages/paramiko/transport.py:219: CryptographyDeprecationWarning: Blowfish has been deprecated
  "class": algorithms.Blowfish,
Packing version 2f88f7d-main
Deploying to Scrapy Cloud project "592160"
Login succeeded
Building an image:
Step 1/12 : FROM scrapinghub/scrapinghub-stack-scrapy:2.0
# Executing 5 build trigger
s
 ---> Using cache
 ---> Using cache
 ---> Using cache
 ---> Using cache
 ---> Using cache
 ---> 277502b8fe88
Step 2/12 : ENV PYTHONUSERBASE=/app/python
 ---> Using cache
 ---> 447eed1a996d
Step 3/12 : ADD eggbased-entrypoint /usr/local/sbin/
 ---> Using cache
 ---> 5f6e9a5c319f
Step 4/12 : ADD run-pipcheck /usr/local/bin/
 ---> Using cache
 ---> 2cb387733ac4
Step 5/12 : RUN chmod +x /usr/local/bin/run-pipcheck
 ---> Using cache
 ---> ef15612fd3a6
Step 6/12 : RUN chmod +x /usr/local/sbin/eggbased-entrypoint &&     ln -sf /usr/local/sbin/eggbased-entrypoint /usr/local/sbin/start-crawl &&     ln -sf /usr/local/sbin/eggbased-entrypoint /usr/local/sbin/scrapy-list &&     ln -sf /usr/local/sbin/eggbased-entrypoint /usr/local/sbin/shub-image-info &&     ln -sf /usr/local/sbin/eggbased-entrypoint /usr/local/sbin/run-pipcheck
 ---> Using cache
 ---> a2ad5338b6fc
Step 7/12 : ADD requirements.txt /app/requirements.txt
 ---> Using cache
 ---> 326def2c8271
Step 8/12 : RUN mkdir /app/python && chown nobody:nogroup /app/python
 ---> Using cache
 ---> 0e8596a62d9c
Step 9/12 : RUN sudo -u nobody -E PYTHONUSERBASE=$PYTHONUSERBASE -E PIP_NO_CACHE_DIR=0     pip install --user --no-cache-dir -r /app/requirements.txt
 ---> [Warning] Your kernel does not support swap limit capabilities or the cgroup is not mounted. Memory limited without swap.
 ---> Running in 1dfa1a19518c
Collecting numpy==1.22.3
  Downloading numpy-1.22.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (16.8 MB)
Collecting scrapy-selenium==0.0.7
  Downloading scrapy_selenium-0.0.7-py3-none-any.whl (6.7 kB)
Collecting urllib3==1.25.1
  Downloading urllib3-1.25.1-py2.py3-none-any.whl (150 kB)
Collecting selenium>=3.9.0
  Downloading selenium-4.2.0-py3-none-any.whl (983 kB)
Requirement already satisfied: scrapy>=1.0.0 in /usr/local/lib/python3.8/site-packages (from scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (2.0.1)
Requirement already satisfied: parsel>=1.5.0 in /usr/local/lib/python3.8/site-packages (from scrapy>=1.0.0->scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (1.6.0)
Requirement already satisfied: lxml>=3.5.0 in /usr/local/lib/python3.8/site-packages (from scrapy>=1.0.0->scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (4.5.1)
Requirement already satisfied: queuelib>=1.4.2 in /usr/local/lib/python3.8/site-packages (from scrapy>=1.0.0->scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (1.5.0)
Requirement already satisfied: PyDispatcher>=2.0.5 in /usr/local/lib/python3.8/site-packages (from scrapy>=1.0.0->scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (2.0.5)
Requirement already satisfied: Twisted>=17.9.0 in /usr/local/lib/python3.8/site-packages (from scrapy>=1.0.0->scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (19.10.0)
Requirement already satisfied: zope.interface>=4.1.3 in /usr/local/lib/python3.8/site-packages (from scrapy>=1.0.0->scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (4.7.2)
Requirement already satisfied: cssselect>=0.9.1 in /usr/local/lib/python3.8/site-packages (from scrapy>=1.0.0->scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (1.1.0)
Requirement already satisfied: cryptography>=2.0 in /usr/local/lib/python3.8/site-packages (from scrapy>=1.0.0->scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (2.9.2)
Requirement already satisfied: pyOpenSSL>=16.2.0 in /usr/local/lib/python3.8/site-packages (from scrapy>=1.0.0->scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (19.1.0)
Requirement already satisfied: w3lib>=1.17.0 in /usr/local/lib/python3.8/site-packages (from scrapy>=1.0.0->scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (1.22.0)
Requirement already satisfied: service-identity>=16.0.0 in /usr/local/lib/python3.8/site-packages (from scrapy>=1.0.0->scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (18.1.0)
Requirement already satisfied: protego>=0.1.15 in /usr/local/lib/python3.8/site-packages (from scrapy>=1.0.0->scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (0.1.16)
Requirement already satisfied: cffi!=1.11.3,>=1.8 in /usr/local/lib/python3.8/site-packages (from cryptography>=2.0->scrapy>=1.0.0->scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (1.14.0)
Requirement already satisfied: six>=1.4.1 in /usr/local/lib/python3.8/site-packages (from cryptography>=2.0->scrapy>=1.0.0->scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (1.14.0)
Requirement already satisfied: pycparser in /usr/local/lib/python3.8/site-packages (from cffi!=1.11.3,>=1.8->cryptography>=2.0->scrapy>=1.0.0->scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (2.20)
Collecting trio~=0.17
  Downloading trio-0.20.0-py3-none-any.whl (359 kB)
Collecting trio-websocket~=0.9
  Downloading trio_websocket-0.9.2-py3-none-any.whl (16 kB)
Collecting urllib3[secure,socks]~=1.26
  Downloading urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Requirement already satisfied: pyasn1-modules in /usr/local/lib/python3.8/site-packages (from service-identity>=16.0.0->scrapy>=1.0.0->scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (0.2.8)
Requirement already satisfied: pyasn1 in /usr/local/lib/python3.8/site-packages (from service-identity>=16.0.0->scrapy>=1.0.0->scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (0.4.8)
Requirement already satisfied: attrs>=16.0.0 in /usr/local/lib/python3.8/site-packages (from service-identity>=16.0.0->scrapy>=1.0.0->scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (19.3.0)
Collecting outcome
  Downloading outcome-1.1.0-py2.py3-none-any.whl (9.7 kB)
Requirement already satisfied: idna in /usr/local/lib/python3.8/site-packages (from trio~=0.17->selenium>=3.9.0->scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (2.9)
Collecting async-generator>=1.9
  Downloading async_generator-1.10-py3-none-any.whl (18 kB)
Collecting sortedcontainers
  Downloading sortedcontainers-2.4.0-py2.py3-none-any.whl (29 kB)
Collecting sniffio
  Downloading sniffio-1.2.0-py3-none-any.whl (10 kB)
Collecting wsproto>=0.14
  Downloading wsproto-1.1.0-py3-none-any.whl (24 kB)
Requirement already satisfied: constantly>=15.1 in /usr/local/lib/python3.8/site-packages (from Twisted>=17.9.0->scrapy>=1.0.0->scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (15.1.0)
Requirement already satisfied: PyHamcrest>=1.9.0 in /usr/local/lib/python3.8/site-packages (from Twisted>=17.9.0->scrapy>=1.0.0->scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (2.0.2)
Requirement already satisfied: Automat>=0.3.0 in /usr/local/lib/python3.8/site-packages (from Twisted>=17.9.0->scrapy>=1.0.0->scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (20.2.0)
Requirement already satisfied: hyperlink>=17.1.1 in /usr/local/lib/python3.8/site-packages (from Twisted>=17.9.0->scrapy>=1.0.0->scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (19.0.0)
Requirement already satisfied: incremental>=16.10.1 in /usr/local/lib/python3.8/site-packages (from Twisted>=17.9.0->scrapy>=1.0.0->scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (17.5.0)
Collecting urllib3[secure,socks]~=1.26
  Downloading urllib3-1.26.8-py2.py3-none-any.whl (138 kB)
  Downloading urllib3-1.26.7-py2.py3-none-any.whl (138 kB)
  Downloading urllib3-1.26.6-py2.py3-none-any.whl (138 kB)
  Downloading urllib3-1.26.5-py2.py3-none-any.whl (138 kB)
  Downloading urllib3-1.26.4-py2.py3-none-any.whl (153 kB)
  Downloading urllib3-1.26.3-py2.py3-none-any.whl (137 kB)
  Downloading urllib3-1.26.2-py2.py3-none-any.whl (136 kB)
  Downloading urllib3-1.26.1-py2.py3-none-any.whl (136 kB)
  Downloading urllib3-1.26.0-py2.py3-none-any.whl (136 kB)
INFO: pip is looking at multiple versions of pyhamcrest to determine which version is compatible with other requirements. This could take a while.
Collecting PyHamcrest>=1.9.0
  Downloading PyHamcrest-2.0.3-py3-none-any.whl (51 kB)
  Downloading PyHamcrest-2.0.1-py3-none-any.whl (52 kB)
  Downloading PyHamcrest-2.0.0-py3-none-any.whl (51 kB)
  Downloading PyHamcrest-1.10.1-py3-none-any.whl (48 kB)
  Downloading PyHamcrest-1.9.0-py2.py3-none-any.whl (52 kB)
Requirement already satisfied: setuptools in /usr/local/lib/python3.8/site-packages (from PyHamcrest>=1.9.0->Twisted>=17.9.0->scrapy>=1.0.0->scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (56.2.0)
Deploy log location: /tmp/shub_deploy_sjufv__d.log
Error: Deploy failed: b'Requirement already satisfied: setuptools in /usr/local/lib/python3.8/site-packages (from PyHamcrest>=1.9.0->Twisted>=17.9.0->scrapy>=1.0.0->scrapy-selenium==0.0.7->-r /app/requirements.txt (line 2)) (56.2.0)'