Can I use python BeautifulSoup library for scraping the pages with ScrapingHub. For some scenarios, Scrapy default selector is not working for example Javascript content. I would like to know if ScrapingHub support BeaufifulSoup.
Yes you can use Python libraries in your code, and would need to deploy the Python libraries as well along with your code to the scrapy cloud as given in the article : Deploying Python Dependencies for your Projects in Scrapy Cloud
Sharad Bajracharya
Can I use python BeautifulSoup library for scraping the pages with ScrapingHub. For some scenarios, Scrapy default selector is not working for example Javascript content. I would like to know if ScrapingHub support BeaufifulSoup.
Yes you can use Python libraries in your code, and would need to deploy the Python libraries as well along with your code to the scrapy cloud as given in the article : Deploying Python Dependencies for your Projects in Scrapy Cloud
thriveni
Yes you can use Python libraries in your code, and would need to deploy the Python libraries as well along with your code to the scrapy cloud as given in the article : Deploying Python Dependencies for your Projects in Scrapy Cloud
-
Unable to select Scrapy project in GitHub
-
ScrapyCloud can't call spider?
-
Unhandled error in Deferred
-
Item API - Filtering
-
newbie to web scraping but need data from zillow
-
ValueError: Invalid control character
-
Cancelling account
-
Best Practices
-
Delete a project in ScrapingHub
See all 434 topics