ScrapingHubCloud Running Splash Crawlers

Posted almost 7 years ago by tdi

Post a topic
Un Answered
t
tdi

Hello,


We are looking into using scrapinghub cloud service to run our crawlers, can anyone tell me whether scrapinghub can run splash crawlers? Or does this require us to purchase the splash plan? Also, we would like to know whether using scrapinghubcloud is quicker than running the crawlers locally?


Can anyone also tell us whether scrapinghub cloud uses a fixed ip or a dynamic ip?


Thanks,


TDI

0 Votes


3 Comments

Sorted by
Pablo Hoffman

Pablo Hoffman posted almost 7 years ago Admin

Gotcha. So you should definitely provision a Splash instance.

0 Votes

t

tdi posted almost 7 years ago

Hi Pablo,


I am running scrapy and splash, currently we are using docker to run splash through as per the instructions on the scraping hub tutorial

0 Votes

Pablo Hoffman

Pablo Hoffman posted almost 7 years ago Admin

You would need to purchase a Splash plan to run Splash crawlers. Are you also using Scrapy or just standalone Splash scripts?

0 Votes

Login to post a comment