I have created a Zyte trial account and am trying to use it scrape pages from a website. Specifically, I am using proxy mode, in python via the "proxies" parameter to requests.get()
However when I try to scrape a url the website is not serving the actual page content, it returns 200 status and html that says the page is not available. However if I visit the same url in the browser it works fine, suggesting the website is blocking my attempt to scrape the page.
I have tried adding the "Zyte-Geolocation" header but it makes no difference.
Hello,
I have created a Zyte trial account and am trying to use it scrape pages from a website. Specifically, I am using proxy mode, in python via the "proxies" parameter to requests.get()
However when I try to scrape a url the website is not serving the actual page content, it returns 200 status and html that says the page is not available. However if I visit the same url in the browser it works fine, suggesting the website is blocking my attempt to scrape the page.
I have tried adding the "Zyte-Geolocation" header but it makes no difference.
What am I doing wrong?
0 Votes
0 Comments
Login to post a comment