videocamWeb Data Extraction Summit - September 30th, 2021.
Join some of the greatest minds in web scraping to educate, inspire, and innovate.
Register for free!
Start a new topic
Answered

Beautifulsoup with ScrapingHub

Can I use python BeautifulSoup library for scraping the pages with ScrapingHub. For some scenarios, Scrapy default selector is not working for example Javascript content. I would like to know if ScrapingHub support BeaufifulSoup.


Best Answer

Yes you can use Python libraries in your code, and would need to deploy the Python libraries as well along with your code to the scrapy cloud as given in the article : Deploying Python Dependencies for your Projects in Scrapy Cloud

1 Comment

Answer

Yes you can use Python libraries in your code, and would need to deploy the Python libraries as well along with your code to the scrapy cloud as given in the article : Deploying Python Dependencies for your Projects in Scrapy Cloud

Login to post a comment