Thanks a lot for sharing. I figured it out but appreciate!
0 Votes
h
harlvlposted
over 5 years ago
You need to either create an image of your own or pull someone else's base image. I'm attaching the one I used. The base is Ubuntu and it has python2 and both chromedriver and geckodriver installed. Remember that deploying docker images is a paid feature so you need to buy at least 1 unit.
Could I be shown an example docker file to integrate selenium into scrapy unit? How do I unzip the chromedriver?
0 Votes
h
harlvlposted
over 5 years ago
Hi, mind if i ask whether using a docker custom image worked or not? My spider needs to use Selenium for firefox too and this looks like would solve my problem.
Hi,
I need to use selenium in my spider to work. Is it even possible? If yes, how to do it?
0 Votes
nestor posted almost 7 years ago Admin Best Answer
This is only possible by deploying a Docker custom image https://shub.readthedocs.io/en/stable/deploy-custom-image.html#deploy-custom-image, note that this feature is only available to users subscribed to at least 1 Scrapy Cloud unit.
0 Votes
5 Comments
Yingke Yu posted over 5 years ago
Thanks a lot for sharing. I figured it out but appreciate!
0 Votes
harlvl posted over 5 years ago
You need to either create an image of your own or pull someone else's base image. I'm attaching the one I used. The base is Ubuntu and it has python2 and both chromedriver and geckodriver installed. Remember that deploying docker images is a paid feature so you need to buy at least 1 unit.
Attachments (1)
Dockerfile.Dockerfile
277 Bytes
0 Votes
Yingke Yu posted over 5 years ago
Could I be shown an example docker file to integrate selenium into scrapy unit? How do I unzip the chromedriver?
0 Votes
harlvl posted over 5 years ago
Hi, mind if i ask whether using a docker custom image worked or not? My spider needs to use Selenium for firefox too and this looks like would solve my problem.
0 Votes
nestor posted almost 7 years ago Admin Answer
This is only possible by deploying a Docker custom image https://shub.readthedocs.io/en/stable/deploy-custom-image.html#deploy-custom-image, note that this feature is only available to users subscribed to at least 1 Scrapy Cloud unit.
0 Votes
Login to post a comment