The job data remains available to ensure it can be restored if needed. The jobs will be marked as deleted, but not removed immediately for this very reason (like moving a file to trash) -- the actual data is wiped 7 days later.
Jobs are deleted daily, but the batch size is limited, so it's normal to see jobs up to a day older than specified in the data retention settings.
Please also refer to this answer on StackOverflow: https://stackoverflow.com/questions/56529737/what-happens-after-scrapy-job-is-deleted-before-it-is-erased/56539708#56539708.
Was this article helpful?
That’s Great!
Thank you for your feedback
Sorry! We couldn't be helpful
Thank you for your feedback
Feedback sent
We appreciate your effort and will try to fix the article