Start a new topic

Declare pure environment variables or custom settings

I want to add some secret values to my crawler (database URI and api keys)


I don't want to add this values to the github repository, but I still want to use Scrapinghub.


I know that I can write custom settings and that this settings in the UI are overwriting my settings in settings.py, but.. in this case I could add the secret values to the UI in settings.


However if I do so, I still getting the variable is None, I have tried to load the settings after generate the start_urls, but it still empty.


How can I add legit environment variables or at least secret values in the config??


I assume I'm not the only one with this issue

Login to post a comment