I have several spiders which need to login to the site I am crawling. Do you have any suggestions on where I can store the passwords if I do not want to include them in the source code of my spider?
8 months ago
Hey Campeni, We do not allow/support login based scraping. Please ensure that you are using our services in compliance with our Terms of Service https://www.zyte.com/terms-policies/terms-of-service/, the terms of the target site, and applicable laws and regulations.