Can I use python BeautifulSoup library for scraping the pages with ScrapingHub. For some scenarios, Scrapy default selector is not working for example Javascript content. I would like to know if ScrapingHub support BeaufifulSoup.
0 Votes
thriveni posted
almost 8 years ago
AdminBest Answer
Can I use python BeautifulSoup library for scraping the pages with ScrapingHub. For some scenarios, Scrapy default selector is not working for example Javascript content. I would like to know if ScrapingHub support BeaufifulSoup.
0 Votes
thriveni posted almost 8 years ago Admin Best Answer
Yes you can use Python libraries in your code, and would need to deploy the Python libraries as well along with your code to the scrapy cloud as given in the article : Deploying Python Dependencies for your Projects in Scrapy Cloud
0 Votes
1 Comments
thriveni posted almost 8 years ago Admin Answer
Yes you can use Python libraries in your code, and would need to deploy the Python libraries as well along with your code to the scrapy cloud as given in the article : Deploying Python Dependencies for your Projects in Scrapy Cloud
0 Votes
Login to post a comment