I want to get the scrapy project id that zyte generates, is there any other method different to the os.getenv('SCRAPY_JOB')?. This method generates a response in the format "project_id/spider_id/job_id" but I only want the project id, is there a method to extract directly the project id or do I have to use split functions to get it?
Best Answer
B
Bala Ravichandran
said
over 1 year ago
This is the default response format "project_id/spider_id/job_id". Yes, you can split functions to get the project ID.
1 Comment
Bala Ravichandran
said
over 1 year ago
Answer
This is the default response format "project_id/spider_id/job_id". Yes, you can split functions to get the project ID.
Alejandro Ueno
I want to get the scrapy project id that zyte generates, is there any other method different to the os.getenv('SCRAPY_JOB')?. This method generates a response in the format "project_id/spider_id/job_id" but I only want the project id, is there a method to extract directly the project id or do I have to use split functions to get it?
This is the default response format "project_id/spider_id/job_id". Yes, you can split functions to get the project ID.
Bala Ravichandran
This is the default response format "project_id/spider_id/job_id". Yes, you can split functions to get the project ID.
1 person likes this
-
Unable to select Scrapy project in GitHub
-
ScrapyCloud can't call spider?
-
Unhandled error in Deferred
-
Item API - Filtering
-
newbie to web scraping but need data from zillow
-
ValueError: Invalid control character
-
Cancelling account
-
Best Practices
-
Beautifulsoup with ScrapingHub
-
Delete a project in ScrapingHub
See all 453 topics