Start a new topic

Page changes when used with Crawlera


I have a spider for which works as expected most of the time.

However, as soon as I enable Crawlera for the project, 4 sections which were previously scraped correctly ("Amenities and More", "About the Business", "Services Offered" and "Highlights from the Business") do not appear anymore.

Now I am wondering:

What could be the reason for this behavior and how could I go about troubleshooting this issue?

Thank you very much in advance,

Patrick Klein

Login to post a comment