Beautifulsoup with ScrapingHub

Posted over 7 years ago by Sharad Bajracharya

Post a topic
Answered
S
Sharad Bajracharya

Can I use python BeautifulSoup library for scraping the pages with ScrapingHub. For some scenarios, Scrapy default selector is not working for example Javascript content. I would like to know if ScrapingHub support BeaufifulSoup.

0 Votes

thriveni

thriveni posted over 7 years ago Admin Best Answer

Yes you can use Python libraries in your code, and would need to deploy the Python libraries as well along with your code to the scrapy cloud as given in the article : Deploying Python Dependencies for your Projects in Scrapy Cloud

0 Votes


1 Comments

thriveni

thriveni posted over 7 years ago Admin Answer

Yes you can use Python libraries in your code, and would need to deploy the Python libraries as well along with your code to the scrapy cloud as given in the article : Deploying Python Dependencies for your Projects in Scrapy Cloud

0 Votes

Login to post a comment