Start a new topic
Answered

Issue with HTTP API on Scrapy Cloud

In Getting Started, I am asked to authenticate using my API key in order to run a spider with curl (the end goal is for a client user on my website to be able to prompt the spiders to run by clicking on a command). However, the websites http://storage.scrapinghub.com/foo and https://storage.scrapinghub.com/foo?apikey=APIKEY (with my API key) return '503 Service Unavailable: No server is available to handle this request.'


Best Answer

Those are not real endpoints (therefore the "foo" endpoint), the getting started page is only showing you 2 ways of passing your credentials for authentication.

The Jobs API using the /run endpoint is what you're looking for  https://doc.scrapinghub.com/api/jobs.html#run-json 

1 Comment

Answer

Those are not real endpoints (therefore the "foo" endpoint), the getting started page is only showing you 2 ways of passing your credentials for authentication.

The Jobs API using the /run endpoint is what you're looking for  https://doc.scrapinghub.com/api/jobs.html#run-json 

Login to post a comment