Wondering if it's possible via the Items API to only request items with a certain value criteria. I have very large datasets, from which I want to write an API call that only returns items where the field value is a certain value.
For example lets say I have a generated field in my spider that is just a Boolean 1/0. I want to be able to call the item API to download a csv of only items with that field =1.
Any ways to accomplish this?
Thanks!
Best Answer
v
vaz
said
about 7 years ago
Hi Austin,
Maybe the best way is through your own code filtering there what you want to scrape.
But check this article, maybe is helpful, but is more UI and possibly not what you are looking for.
Best,
Pablo
1 Comment
vaz
said
about 7 years ago
Answer
Hi Austin,
Maybe the best way is through your own code filtering there what you want to scrape.
But check this article, maybe is helpful, but is more UI and possibly not what you are looking for.
austinseg
Wondering if it's possible via the Items API to only request items with a certain value criteria. I have very large datasets, from which I want to write an API call that only returns items where the field value is a certain value.
For example lets say I have a generated field in my spider that is just a Boolean 1/0. I want to be able to call the item API to download a csv of only items with that field =1.
Any ways to accomplish this?
Thanks!
Hi Austin,
Maybe the best way is through your own code filtering there what you want to scrape.
But check this article, maybe is helpful, but is more UI and possibly not what you are looking for.
Best,
Pablo
vaz
Hi Austin,
Maybe the best way is through your own code filtering there what you want to scrape.
But check this article, maybe is helpful, but is more UI and possibly not what you are looking for.
Best,
Pablo
-
Unable to select Scrapy project in GitHub
-
ScrapyCloud can't call spider?
-
Unhandled error in Deferred
-
newbie to web scraping but need data from zillow
-
ValueError: Invalid control character
-
Cancelling account
-
Best Practices
-
Beautifulsoup with ScrapingHub
-
Delete a project in ScrapingHub
See all 460 topics