why scrapy works (sometimes) on WeatherUnderground ?
W
Willy Pregliasco
started a topic
over 3 years ago
I'm a newbie scrapping and following your amazing tutorials finally I mede a spider for Weather Underground. I want to download the daily log of a station. (See for example this test-page).
It works ! But I did not expect to work before adding Splash, because inspecting the page, the final table is rendered by a JS code.
Why is this working? Can I rely on this spider or maybe it will broke sometimes due to rendering issues ?
Maybe is a silly question, but I can't imagine what's going on.
Willy Pregliasco
I'm a newbie scrapping and following your amazing tutorials finally I mede a spider for Weather Underground. I want to download the daily log of a station. (See for example this test-page).
It works ! But I did not expect to work before adding Splash, because inspecting the page, the final table is rendered by a JS code.
Why is this working? Can I rely on this spider or maybe it will broke sometimes due to rendering issues ?
Maybe is a silly question, but I can't imagine what's going on.
Thanks.
Willy Pregliasco, Bariloche, Argentina