Smart Proxy Manager Advanced Topics

Understanding Zyte Smart Proxy Manager Errors
When a request fails for some reason, Zyte Smart Proxy Manager(formerly Crawlera) will include an error message in the X-Crawlera-Error header. Please refe...
Tue, 2 Feb, 2021 at 9:11 PM
Desktop and Mobile Profiles
X-Crawlera-Profile is a header that is meant to replace X-Crawlera-UA. It not only sets the User-Agent but also applies a set of headers which are actually ...
Wed, 3 Mar, 2021 at 8:17 AM
How To Deal With Bans ('503' Responses From Zyte Smart Proxy Manager)
When Zyte Smart Proxy Manager(formerly Crawlera) gets a ban from a target website, it automatically retries the request from another proxy IP.  By defaul...
Wed, 3 Mar, 2021 at 8:31 AM
How to use Zyte Smart Proxy Manager with headless browsers
⚠️  Note: Headless browser support is only available in Advanced and Enterprise plans. Overview Crawling with a headless browser is different from t...
Tue, 2 Feb, 2021 at 9:22 PM
Changes to the behavior of X-Crawlera-Profile header
We are changing the behavior of a custom header (X-Crawlera-Profile) that can be sent along with your request to Smart Proxy Manager. This change is expecte...
Wed, 3 Mar, 2021 at 8:19 AM
Using Zyte Smart Proxy Manager Sessions to make multiple requests from the same IP
⚠️  Note: Sessions are only available on Zyte Smart Proxy Manager(formerly Crawlera) Advanced, C50, C100, C200 and Enterprise plans. With Smart Proxy Ma...
Tue, 2 Feb, 2021 at 9:24 PM