using datetime in setting e.g feed_uri

Posted over 4 years ago by paul gibbons

Post a topic
Un Answered
p
paul gibbons

 I have a spider which writes data to s3.

locally I specify the file to write to a date separated folder in s3.

I want to replicate the feed URI setting in scraping hub, is it possible to replicate the behavior below?


import  datetime
today = datetime.date.today()
FEED_URI = 's3://relayplay-prebackend/ev_scrapedata/' + today.strftime("%Y/%m/%d") + '/eventbrite_spider.csv'

0 Votes


0 Comments

Login to post a comment