videocamWeb Data Extraction Summit - September 30th, 2021.
Join some of the greatest minds in web scraping to educate, inspire, and innovate.
Register for free!
Start a new topic
Answered

Puppeteer redirects to proxy login page

I've followed the instructions to integrate Crawlera with Puppeteer, but after I run the code I keep being redirected to the proxy login page stating:

the proxy proxy.crawlera.com requires a username and password

const browser = await puppeteer.launch({
      args:
      `--proxy-server=proxy.crawlera.com:8010`,
      ],
      timeout: 0,
      headless: false,
      ignoreHTTPSErrors: true,
    });

const page = await browser.newPage();
    await page.setExtraHTTPHeaders({
        'Proxy-Authorization': 'Basic ' + Buffer.from('KEY:').toString('base64'),
    });

 


Best Answer

Make sure to use your Crawlera API Key found on the settings part of your Crawlera overview page.


Also not working for me. But I get the error "net::ERR_UNEXPECTED_PROXY_AUTH", using Puppeteer v1.6.0.

Answer

Make sure to use your Crawlera API Key found on the settings part of your Crawlera overview page.

Login to post a comment