Start a new topic

Declare pure environment variables or custom settings

I want to add some secret values to my crawler (database URI and api keys)

I don't want to add this values to the github repository, but I still want to use Scrapinghub.

I know that I can write custom settings and that this settings in the UI are overwriting my settings in, but.. in this case I could add the secret values to the UI in settings.

However if I do so, I still getting the variable is None, I have tried to load the settings after generate the start_urls, but it still empty.

How can I add legit environment variables or at least secret values in the config??

I assume I'm not the only one with this issue

1 person has this question
Login to post a comment