Zyte Support Center
How can we help you today?
Not able to extract Xpath link
1 Comment
aurish_hammad_hafeez
said
about 5 years ago
Because amazon is changing the html through JavaScript, if you run view(response) in scrapy shell and then inspect element you will see class name changed to pagnNext but as it has an id so this will work
response.xpath('//*[@id="pagnNextLink"]/@href').extract_first()
Vinay C
Hi,
I am not able to extract the XPath for pagination ('next' button) link in - https://www.amazon.com.au/s?k=tablet
I tried in scrapy shell to extract:
response.xpath('//li[@class="a-last"]/a/@href').extract_first()
but it doesn't output the link.
Please see the attached screenshot of the HTML code.
Many thanks,
Vinay