how to use feed to upload files to GCS using API keys in zyte

Posted 4 months ago by Tylletsun

Post a topic
Un Answered
T
Tylletsun

data = pkgutil.get_data("project", "resources/x-jobs-402313-cc765b1e2c6f.json")
json_path = "/resources/x-jobs-402313-cc765b1e2c6f.json"
os.environ['GOOGLE_APPLICATION_CREDENTIALS'] = json_path

class MeetJobSpider(scrapy.Spider):

name = "meet_job"

custom_settings = {
'FEEDS': {f'gs://scrapy_output_test/meet_job/meet_job_{str(utc8_date)}.csv': {'format': 'csv', 'overwrite': True}}
}

I want to use feeds to upload data to gcs, I have sucessfully upload to GCS in local, but when in zyte, the file isn't upload and there is no error. The json is my api key. Please Help!

0 Votes


0 Comments

Login to post a comment