Start a new topic

why scrapy works (sometimes) on WeatherUnderground ?

 I'm a newbie scrapping and following your amazing tutorials finally I mede a spider for Weather Underground. I want to download the daily log of a station. (See for example this test-page)


It works !  But I did not expect to work before adding Splash, because inspecting the page, the final table is rendered by a JS code.


Why is this working? Can I rely on this spider or maybe it will broke sometimes due to rendering issues ? 


Maybe is a silly question, but I can't imagine what's going on.

Thanks.     

Willy Pregliasco, Bariloche, Argentina

Login to post a comment