According to the Scrapy Cloud Results docs[1] the CSV parameter `fields` is required which does not allow me to get results back in the original order. In other words I want the CSV fields to be in the order that I originally wrote them to the API in.
I understand I can set this in the Project Settings which applies to all items for all jobs which is not what I want since we have many item formats; I just want the original item order.
I understand now that all items must display the fields in the same order for CSV to have valid results; so, I guess there could be default field discovery by reading the the first record and using that as the field order, perhaps.
Feature request: make `fields` optional
According to the Scrapy Cloud Results docs[1] the CSV parameter `fields` is required which does not allow me to get results back in the original order. In other words I want the CSV fields to be in the order that I originally wrote them to the API in.
I understand I can set this in the Project Settings which applies to all items for all jobs which is not what I want since we have many item formats; I just want the original item order.
[1] https://doc.scrapinghub.com/scrapy-cloud.html#csv-parameters
0 Votes
1 Comments
Steven Almeroth posted over 6 years ago
I understand now that all items must display the fields in the same order for CSV to have valid results; so, I guess there could be default field discovery by reading the the first record and using that as the field order, perhaps.
0 Votes
Login to post a comment