Deploy result success but 0 spiders. Custom deploy

Posted about 1 year ago by Kristiqn Tashev

Post a topic
Un Answered
K
Kristiqn Tashev

 Hello everyone, I'm trying to deploy custom spider with this dockerfile:


FROM python:3.11.4-slim-bullseye

WORKDIR /app
COPY . /app

RUN apt-get update \
&& pip install --no-cache-dir --upgrade pip \
&& pip install --no-cache-dir -r requirements.txt \
&& playwright install --with-deps chromium \
&& mv /root/.cache/ms-playwright /ms-playwright \
&& mv /ms-playwright/chromium-* /ms-playwright/chromium \
# && mv /ms-playwright/firefox-* /ms-playwright/firefox \
# && mv /ms-playwright/webkit-* /ms-playwright/webkit \
&& chmod -Rf 777 /ms-playwright

RUN python setup.py install

keep in mind i manually generate setup.py

from setuptools import setup, find_packages

setup(
name="project",
version="1.0",
packages=find_packages(),
entry_points={"scrapy": ["settings = zora_spider.settings"]},
)

and my scrapinghub.yml is:

image: true
project: {my id here}

got success message:

{'status': 'ok', 'project': {my id}, 'version':{my version}, 'spiders': 0}

what I did wrong?

0 Votes


1 Comments

K

Kristiqn Tashev posted about 1 year ago

I fix it issue was the name of the spider.

0 Votes

Login to post a comment