No recent searches
Popular Articles
Sorry! nothing found for
Posted over 1 year ago by Mat Valen
i am trying to deploy with scrapy 2.8 when i deploy the requirements.txt file i get these errors, does anyone have any idea what it could be? Login succeeded
Building an image:
Step 1/12 : FROM scrapinghub/scrapinghub-stack-scrapy:2.0
# Executing 5 build trigger
s
---> Using cache
---> 174fb002bc93
Step 2/12 : ENV PYTHONUSERBASE=/app/python
---> 62f4f6110a6e
Step 3/12 : ADD eggbased-entrypoint /usr/local/sbin/
---> 2e8007f27616
Step 4/12 : ADD run-pipcheck /usr/local/bin/
---> 1478a0f5a20b
Step 5/12 : RUN chmod +x /usr/local/bin/run-pipcheck
---> 716a797504e1
Step 6/12 : RUN chmod +x /usr/local/sbin/eggbased-entrypoint && ln -sf /usr/local/sbin/eggbased-entrypoint /usr/local/sbin/start-crawl && ln -sf /usr/local/sbin/eggbased-entrypoint /usr/local/sbin/scrapy-list && ln -sf /usr/local/sbin/eggbased-entrypoint /usr/local/sbin/shub-image-info && ln -sf /usr/local/sbin/eggbased-entrypoint /usr/local/sbin/run-pipcheck
---> ef0d9a109708
Step 7/12 : ADD requirements.txt /app/requirements.txt
---> 023905a25a4e
Step 8/12 : RUN mkdir /app/python && chown nobody:nogroup /app/python
---> a70182cc20a8
Step 9/12 : RUN sudo -u nobody -E PYTHONUSERBASE=$PYTHONUSERBASE -E PIP_NO_CACHE_DIR=0 pip install --user --no-cache-dir -r /app/requirements.txt
---> b7ddd2e34177
Step 10/12 : COPY *.egg /app/
---> cb15caf58757
Step 11/12 : RUN if [ -d "/app/addons_eggs" ]; then rm -f /app/*.dash-addon.egg; fi
---> Running in 93ae757cce44
Removing intermediate container 93ae757cce44
---> 5664ec9aede3
Step 12/12 : ENV PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
---> Running in d9835cfc540d
Removing intermediate container d9835cfc540d
---> 8d2654977f14
Successfully built 8d2654977f14
Successfully tagged i.scrapinghub.com/kumo_project/644946:29
Step 1/3 : FROM alpine:3.5
---> f80194ae2e0c
Step 2/3 : ADD kumo-entrypoint /kumo-entrypoint
---> bd44dae40011
Step 3/3 : RUN chmod +x /kumo-entrypoint
---> 4414cc5cd408
Successfully built 4414cc5cd408
Successfully tagged kumo-entrypoint:latest
Entrypoint container is created successfully
>>> Checking python dependencies
Collecting pip<20.0,>=9.0.3
Downloading pip-19.3.1-py2.py3-none-any.whl (1.4 MB)
Installing collected packages: pip
Successfully installed pip-19.3.1
botocore 1.16.14 has requirement jmespath<1.0.0,>=0.7.1, but you have jmespath 1.0.1.
botocore 1.16.14 has requirement urllib3<1.26,>=1.20; python_version != "3.4", but you have urllib3 1.26.15.
boto3 1.13.14 has requirement jmespath<1.0.0,>=0.7.1, but you have jmespath 1.0.1.
Warning: Pip checks failed, please fix the conflicts.
WARNING: There're some errors when doing pip-check:
WARNING: Ignoring invalid distribution -main- (/app/__main__.egg)
WARNING: The scripts pip, pip3 and pip3.8 are installed in '/app/python/bin' which is not on PATH.
Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
{"error": "requirements_error", "message": "Dependencies check exit code: 1", "details": "Pip checks failed, please fix the conflicts"}
my requiremets.txt attrs==22.2.0
Automat==22.10.0
certifi==2022.12.7
cffi==1.15.1
charset-normalizer==3.1.0
constantly==15.1.0
cryptography==40.0.1
cssselect==1.2.0
dropbox==11.36.0
et-xmlfile==1.1.0
filelock==3.10.7
hyperlink==21.0.0
idna==3.4
incremental==22.10.0
itemadapter==0.7.0
itemloaders==1.0.6
jmespath==1.0.1
lxml==4.9.2
numpy==1.24.2
openpyxl==3.1.2
packaging==23.0
pandas==1.5.3
parsel==1.7.0
ply==3.11
Protego==0.2.1
pyasn1==0.4.8
pyasn1-modules==0.2.8
pycparser==2.21
PyDispatcher==2.0.7
pyOpenSSL==23.1.1
python-dateutil==2.8.2
pytz==2023.3
queuelib==1.6.2
requests==2.28.2
requests-file==1.5.1
service-identity==21.1.0
six==1.16.0
stone==3.3.1
tldextract==3.4.0
Twisted==22.10.0
typing_extensions==4.5.0
urllib3==1.26.15
w3lib==2.1.1
zope.interface==6.0
0 Votes
1 Comments
Sergey Geron posted over 1 year ago Admin
Hi Mat, this is Sergey Geron, Business Analyst at Zyte.
Thank you for reaching out through our Forum.
Could you please create a support ticket here - https://support.zyte.com/support/tickets/new
Login to post a comment
People who like this
This post will be deleted permanently. Are you sure?
i am trying to deploy with scrapy 2.8 when i deploy the requirements.txt file i get these errors, does anyone have any idea what it could be? Login succeeded
Building an image:
Step 1/12 : FROM scrapinghub/scrapinghub-stack-scrapy:2.0
# Executing 5 build trigger
s
---> Using cache
---> Using cache
---> Using cache
---> Using cache
---> Using cache
---> 174fb002bc93
Step 2/12 : ENV PYTHONUSERBASE=/app/python
---> Using cache
---> 62f4f6110a6e
Step 3/12 : ADD eggbased-entrypoint /usr/local/sbin/
---> Using cache
---> 2e8007f27616
Step 4/12 : ADD run-pipcheck /usr/local/bin/
---> Using cache
---> 1478a0f5a20b
Step 5/12 : RUN chmod +x /usr/local/bin/run-pipcheck
---> Using cache
---> 716a797504e1
Step 6/12 : RUN chmod +x /usr/local/sbin/eggbased-entrypoint && ln -sf /usr/local/sbin/eggbased-entrypoint /usr/local/sbin/start-crawl && ln -sf /usr/local/sbin/eggbased-entrypoint /usr/local/sbin/scrapy-list && ln -sf /usr/local/sbin/eggbased-entrypoint /usr/local/sbin/shub-image-info && ln -sf /usr/local/sbin/eggbased-entrypoint /usr/local/sbin/run-pipcheck
---> Using cache
---> ef0d9a109708
Step 7/12 : ADD requirements.txt /app/requirements.txt
---> Using cache
---> 023905a25a4e
Step 8/12 : RUN mkdir /app/python && chown nobody:nogroup /app/python
---> Using cache
---> a70182cc20a8
Step 9/12 : RUN sudo -u nobody -E PYTHONUSERBASE=$PYTHONUSERBASE -E PIP_NO_CACHE_DIR=0 pip install --user --no-cache-dir -r /app/requirements.txt
---> Using cache
---> b7ddd2e34177
Step 10/12 : COPY *.egg /app/
---> cb15caf58757
Step 11/12 : RUN if [ -d "/app/addons_eggs" ]; then rm -f /app/*.dash-addon.egg; fi
---> Running in 93ae757cce44
Removing intermediate container 93ae757cce44
---> 5664ec9aede3
Step 12/12 : ENV PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
---> Running in d9835cfc540d
Removing intermediate container d9835cfc540d
---> 8d2654977f14
Successfully built 8d2654977f14
Successfully tagged i.scrapinghub.com/kumo_project/644946:29
Step 1/3 : FROM alpine:3.5
---> f80194ae2e0c
Step 2/3 : ADD kumo-entrypoint /kumo-entrypoint
---> Using cache
---> bd44dae40011
Step 3/3 : RUN chmod +x /kumo-entrypoint
---> Using cache
---> 4414cc5cd408
Successfully built 4414cc5cd408
Successfully tagged kumo-entrypoint:latest
Entrypoint container is created successfully
>>> Checking python dependencies
Collecting pip<20.0,>=9.0.3
Downloading pip-19.3.1-py2.py3-none-any.whl (1.4 MB)
Installing collected packages: pip
Successfully installed pip-19.3.1
botocore 1.16.14 has requirement jmespath<1.0.0,>=0.7.1, but you have jmespath 1.0.1.
botocore 1.16.14 has requirement urllib3<1.26,>=1.20; python_version != "3.4", but you have urllib3 1.26.15.
boto3 1.13.14 has requirement jmespath<1.0.0,>=0.7.1, but you have jmespath 1.0.1.
Warning: Pip checks failed, please fix the conflicts.
WARNING: There're some errors when doing pip-check:
WARNING: Ignoring invalid distribution -main- (/app/__main__.egg)
WARNING: Ignoring invalid distribution -main- (/app/__main__.egg)
WARNING: Ignoring invalid distribution -main- (/app/__main__.egg)
WARNING: The scripts pip, pip3 and pip3.8 are installed in '/app/python/bin' which is not on PATH.
Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
{"error": "requirements_error", "message": "Dependencies check exit code: 1", "details": "Pip checks failed, please fix the conflicts"}
my requiremets.txt attrs==22.2.0
Automat==22.10.0
certifi==2022.12.7
cffi==1.15.1
charset-normalizer==3.1.0
constantly==15.1.0
cryptography==40.0.1
cssselect==1.2.0
dropbox==11.36.0
et-xmlfile==1.1.0
filelock==3.10.7
hyperlink==21.0.0
idna==3.4
incremental==22.10.0
itemadapter==0.7.0
itemloaders==1.0.6
jmespath==1.0.1
lxml==4.9.2
numpy==1.24.2
openpyxl==3.1.2
packaging==23.0
pandas==1.5.3
parsel==1.7.0
ply==3.11
Protego==0.2.1
pyasn1==0.4.8
pyasn1-modules==0.2.8
pycparser==2.21
PyDispatcher==2.0.7
pyOpenSSL==23.1.1
python-dateutil==2.8.2
pytz==2023.3
queuelib==1.6.2
requests==2.28.2
requests-file==1.5.1
service-identity==21.1.0
six==1.16.0
stone==3.3.1
tldextract==3.4.0
Twisted==22.10.0
typing_extensions==4.5.0
urllib3==1.26.15
w3lib==2.1.1
zope.interface==6.0
0 Votes
1 Comments
Sergey Geron posted over 1 year ago Admin
Hi Mat, this is Sergey Geron, Business Analyst at Zyte.
Thank you for reaching out through our Forum.
Could you please create a support ticket here - https://support.zyte.com/support/tickets/new
0 Votes
Login to post a comment