How do I call list jobs in a paginated fashion?

Posted over 7 years ago by bressler

Post a topic
Answered
b
bressler

I tried: 

https://app.scrapinghub.com/api/jobs/list.json?project=<project-num?&spider=<spider-name>&state=finished&start=125

  as well as:

https://app.scrapinghub.com/api/jobs/list.json?project=<project-num?&spider=<spider-name>&state=finished&start=<project-id>/1/125

But neither returned anything but the most recent 100 results. How do I get older results?

0 Votes

nestor

nestor posted over 7 years ago Admin Best Answer

Hi,


for list.json the pagination keyword is "offset" instead of "start".

1 Votes


2 Comments

Sorted by
b

bressler posted over 7 years ago

Thanks! Worked like a charm. Can this be documented?

0 Votes

nestor

nestor posted over 7 years ago Admin Answer

Hi,


for list.json the pagination keyword is "offset" instead of "start".

1 Votes

Login to post a comment