videocamWeb Data Extraction Summit - September 30th, 2021.
Join some of the greatest minds in web scraping to educate, inspire, and innovate.
Register for free!

Smart Proxy Manager Advanced Topics

Understanding Zyte Smart Proxy Manager Errors
When a request fails for some reason, Zyte Smart Proxy Manager(formerly Crawlera) will include an error message in the X-Crawlera-Error header. Please refe...
Tue, 2 Feb, 2021 at 9:11 PM
Desktop and Mobile Profiles
X-Crawlera-Profile is a header that is meant to replace X-Crawlera-UA. It not only sets the User-Agent but also applies a set of headers which are actually ...
Wed, 3 Mar, 2021 at 8:17 AM
How To Deal With Bans ('503' Responses From Zyte Smart Proxy Manager)
When Zyte Smart Proxy Manager(formerly Crawlera) gets a ban from a target website, it automatically retries the request from another proxy IP.  By defaul...
Sat, 5 Jun, 2021 at 12:39 PM
How to use Zyte Smart Proxy Manager with headless browsers
⚠️  Note: Headless browser support is now available in all the plans. Overview Crawling with a headless browser is different from traditional approa...
Wed, 5 May, 2021 at 3:51 PM
Changes to the behavior of X-Crawlera-Profile header
We are changing the behavior of a custom header (X-Crawlera-Profile) that can be sent along with your request to Smart Proxy Manager. This change is expecte...
Wed, 3 Mar, 2021 at 8:19 AM
Using Zyte Smart Proxy Manager Sessions to make multiple requests from the same IP
⚠️  Note: Sessions are only available on Zyte Smart Proxy Manager(formerly Crawlera) Advanced, C50, C100, C200 and Enterprise plans. With Smart Proxy Ma...
Tue, 2 Feb, 2021 at 9:24 PM