Start a new topic

Scrapy Cloud Results parameters

Feature request: make `fields` optional


According to the Scrapy Cloud Results docs[1] the CSV parameter `fields` is required which does not allow me to get results back in the original order. In other words I want the CSV fields to be in the order that I originally wrote them to the API in.


I understand I can set this in the Project Settings which applies to all items for all jobs which is not what I want since we have many item formats; I just want the original item order.


[1] https://doc.scrapinghub.com/scrapy-cloud.html#csv-parameters

1 Comment

I understand now that all items must display the fields in the same order for CSV to have valid results; so, I guess there could be default field discovery by reading the the first record and using that as the field order, perhaps.

Login to post a comment