How do I call list jobs in a paginated fashion?

Posted about 7 years ago by bressler

Post a topic

Answered

bressler

I tried:

https://app.scrapinghub.com/api/jobs/list.json?project=<project-num?&spider=<spider-name>&state=finished&start=125

as well as:

https://app.scrapinghub.com/api/jobs/list.json?project=<project-num?&spider=<spider-name>&state=finished&start=<project-id>/1/125

But neither returned anything but the most recent 100 results. How do I get older results?

0 Votes

nestor posted about 7 years ago Admin Best Answer

Hi,

for list.json the pagination keyword is "offset" instead of "start".

1 Votes

2 Comments

bressler posted about 7 years ago

Thanks! Worked like a charm. Can this be documented?

0 Votes

nestor posted about 7 years ago Admin Answer

Hi,

for list.json the pagination keyword is "offset" instead of "start".

1 Votes