Start a new topic

Shub deploy with custom Docker image fails

Hi, I am getting 

ModuleNotFoundError: No module named 'enervee_scraper'

  when running  

shub image deploy

 for project ID 444444.


Dockerfile:

FROM python:3.7

WORKDIR /app

COPY requirements.txt .

RUN pip install -r requirements.txt
ENV SCRAPY_SETTINGS_MODULE enervee_scraper.settings.local
ENV PYTHONPATH "${PYTHONPATH}:/app"

Project structure:

 

enervee_scraper/
      settings/
      spiders/
      tests/

Dockerfile
.dockerignore
scrapinghub.yml
scrapy.cfg

 scrapy.cfg:

[settings]
default = enervee_scraper.settings.prod
local = enervee_scraper.settings.local

[deploy]
#url = http://localhost:6800/
project = enervee_scraper

My crawler works fine using the Docker image locally.

1 Comment

Nevermind, I found the issue. Please close this topic.