Start a new topic

how to use feed to upload files to GCS using API keys in zyte

data = pkgutil.get_data("project", "resources/x-jobs-402313-cc765b1e2c6f.json")
json_path = "/resources/x-jobs-402313-cc765b1e2c6f.json"
os.environ['GOOGLE_APPLICATION_CREDENTIALS'] = json_path

class MeetJobSpider(scrapy.Spider):

name = "meet_job"

custom_settings = {
'FEEDS': {f'gs://scrapy_output_test/meet_job/meet_job_{str(utc8_date)}.csv': {'format': 'csv', 'overwrite': True}}
}

I want to use feeds to upload data to gcs, I have sucessfully upload to GCS in local, but when in zyte, the file isn't upload and there is no error. The json is my api key. Please Help!
Login to post a comment