Please see python-scrapinghubclient library. This can be used to get the list of Projects and then iterate over them to get the list of spiders and get Items.
Yes, that's helped. We can get the list of projects for APIkey at least. Not for organization, but that's much better than before. Thanks!
thriveni
said
over 6 years ago
Answer
Hello Juisaeva,
Please see python-scrapinghubclient library. This can be used to get the list of Projects and then iterate over them to get the list of spiders and get Items.
I need to get from the request result xxx, yyy, zzz, www, qqq
Or at least numbers of the projects: 222, 333, 444 (I don't want to specify them manually in my curl-request), for iterating over them to get the list of spiders\jobs.
juisaeva
Hi!
I actually didn't find this in the API reference or API documentation: how can I get list of the jobs for the particular organization?
I'm looking for something like this:
$ curl -u APIKEY "https://app.scrapinghub.com/api/list.json?organization=123"
Thank you!
Hello Juisaeva,
Please see python-scrapinghub client library. This can be used to get the list of Projects and then iterate over them to get the list of spiders and get Items.
Regards,
Thriveni
- Oldest First
- Popular
- Newest First
Sorted by Newest Firstjuisaeva
thriveni
Hello Juisaeva,
Please see python-scrapinghub client library. This can be used to get the list of Projects and then iterate over them to get the list of spiders and get Items.
Regards,
Thriveni
1 person likes this
juisaeva
E.g. I have something like this:
Org1:
project 123 (spiders: ''aaa', 'bbb'), project 124(spders:"ccc", "ddd"), project 125 (spiders: "eee")
Org2:
project 222 (spiders: 'xxx', 'yyy'), project 333 (spiders: ''zzz', 'www'), project 444 (spiders: 'qqq'")
I need to get from the request result xxx, yyy, zzz, www, qqq
Or at least numbers of the projects: 222, 333, 444 (I don't want to specify them manually in my curl-request), for iterating over them to get the list of spiders\jobs.
vaz
Hi Juisaeva,
Please check this documentation: https://doc.scrapinghub.com/api/jobs.html#jobs-list-json-jl
I hope this helps.
Best,
Pablo
-
Unable to select Scrapy project in GitHub
-
ScrapyCloud can't call spider?
-
Unhandled error in Deferred
-
Item API - Filtering
-
newbie to web scraping but need data from zillow
-
ValueError: Invalid control character
-
Cancelling account
-
Best Practices
-
Beautifulsoup with ScrapingHub
-
Delete a project in ScrapingHub
See all 453 topics