In Getting Started, I am asked to authenticate using my API key in order to run a spider with curl (the end goal is for a client user on my website to be able to prompt the spiders to run by clicking on a command). However, the websites http://storage.scrapinghub.com/foo and https://storage.scrapinghub.com/foo?apikey=APIKEY (with my API key) return '503 Service Unavailable: No server is available to handle this request.'
Best Answer
n
nestor
said
over 3 years ago
Those are not real endpoints (therefore the "foo" endpoint), the getting started page is only showing you 2 ways of passing your credentials for authentication.
Those are not real endpoints (therefore the "foo" endpoint), the getting started page is only showing you 2 ways of passing your credentials for authentication.
daynetran
In Getting Started, I am asked to authenticate using my API key in order to run a spider with curl (the end goal is for a client user on my website to be able to prompt the spiders to run by clicking on a command). However, the websites http://storage.scrapinghub.com/foo and https://storage.scrapinghub.com/foo?apikey=APIKEY (with my API key) return '503 Service Unavailable: No server is available to handle this request.'
Those are not real endpoints (therefore the "foo" endpoint), the getting started page is only showing you 2 ways of passing your credentials for authentication.
The Jobs API using the /run endpoint is what you're looking for https://doc.scrapinghub.com/api/jobs.html#run-json
nestor
Those are not real endpoints (therefore the "foo" endpoint), the getting started page is only showing you 2 ways of passing your credentials for authentication.
The Jobs API using the /run endpoint is what you're looking for https://doc.scrapinghub.com/api/jobs.html#run-json
-
Unable to select Scrapy project in GitHub
-
ScrapyCloud can't call spider?
-
Unhandled error in Deferred
-
Item API - Filtering
-
newbie to web scraping but need data from zillow
-
ValueError: Invalid control character
-
Cancelling account
-
Best Practices
-
Beautifulsoup with ScrapingHub
-
Delete a project in ScrapingHub
See all 452 topics