Hello,
We are not able running custom script since we use shub-image version 0.2.5, but with shub 2.5.1 it work . Can you help us on it ?
Look on setup.py below :
from setuptools import setup, find_packages
setup(
name = 'EU-Crawler',
version = '1.0',
packages = find_packages(),
scripts = [
'bin/launcher.py',
'bin/DE_WEB_launcher.py',
'bin/ES_WEB_launcher.py',
'bin/FR_WEB_launcher.py',
'bin/IT_WEB_launcher.py',
'bin/NL_WEB_launcher.py',
'bin/DE_MOBILE_launcher.py',
'bin/FR_MOBILE_launcher.py'
],
package_data = {
'Crawling': ['*.ini'],
},
entry_points = {'scrapy': ['settings = Crawling.settings']},
install_requires=[
'scrapy-crawlera>=1.2.2',
'configobj',
'scrapy-fake-useragent',
'xmltodict',
'selenium==2.53.2',
'python-dateutil',
'pyvirtualdisplay',
'beautifulsoup4',
'incapsula-cracker-py3'
extras_require={'ScrapyElasticSearch': 'ScrapyElasticSearch[extras]'},
zip_safe = False,
include_package_data=True
)
Thanks
shub-image as a standalone is deprecated and it is now part of shub 2.70+. Please use shub with image command instead: http://shub.readthedocs.io/en/stable/deploy-custom-image.html#deploy-custom-image
With shub version 2.7 don't work
with shub-image 0.2.5 and shub 2.5.1 it work
IT DATAIMPACT
Hello,
We are not able running custom script since we use shub-image version 0.2.5, but with shub 2.5.1 it work . Can you help us on it ?
Look on setup.py below :
from setuptools import setup, find_packages
setup(
name = 'EU-Crawler',
version = '1.0',
packages = find_packages(),
scripts = [
'bin/launcher.py',
'bin/DE_WEB_launcher.py',
'bin/ES_WEB_launcher.py',
'bin/FR_WEB_launcher.py',
'bin/IT_WEB_launcher.py',
'bin/NL_WEB_launcher.py',
'bin/DE_MOBILE_launcher.py',
'bin/FR_MOBILE_launcher.py'
],
package_data = {
'Crawling': ['*.ini'],
},
entry_points = {'scrapy': ['settings = Crawling.settings']},
install_requires=[
'scrapy-crawlera>=1.2.2',
'configobj',
'scrapy-fake-useragent',
'xmltodict',
'selenium==2.53.2',
'python-dateutil',
'pyvirtualdisplay',
'beautifulsoup4',
'incapsula-cracker-py3'
],
extras_require={'ScrapyElasticSearch': 'ScrapyElasticSearch[extras]'},
zip_safe = False,
include_package_data=True
)
Thanks
shub-image as a standalone is deprecated and it is now part of shub 2.70+. Please use shub with image command instead: http://shub.readthedocs.io/en/stable/deploy-custom-image.html#deploy-custom-image
- Oldest First
- Popular
- Newest First
Sorted by Oldest FirstIT DATAIMPACT
With shub version 2.7 don't work
with shub-image 0.2.5 and shub 2.5.1 it work
nestor
shub-image as a standalone is deprecated and it is now part of shub 2.70+. Please use shub with image command instead: http://shub.readthedocs.io/en/stable/deploy-custom-image.html#deploy-custom-image
-
Unable to select Scrapy project in GitHub
-
ScrapyCloud can't call spider?
-
Unhandled error in Deferred
-
Item API - Filtering
-
newbie to web scraping but need data from zillow
-
ValueError: Invalid control character
-
Cancelling account
-
Best Practices
-
Beautifulsoup with ScrapingHub
-
Delete a project in ScrapingHub
See all 460 topics