I want to scrape a website by entering its URLs. When I access the site, I need to click a button about 20 times, and each button click triggers an API request in the backend to retrieve more data.
For example, the page displays 100 results out of a total of 10,000. To view more results, I have to click the 'next page' button, which sends another API request to fetch the next 100 results. My question is: how are the requests counted? Is it one request per URL I visit or one request for each API call made in the backend of the website?
I want to scrape a website by entering its URLs. When I access the site, I need to click a button about 20 times, and each button click triggers an API request in the backend to retrieve more data.
For example, the page displays 100 results out of a total of 10,000. To view more results, I have to click the 'next page' button, which sends another API request to fetch the next 100 results. My question is: how are the requests counted? Is it one request per URL I visit or one request for each API call made in the backend of the website?
0 Votes
1 Comments
Basile Verhulst posted about 1 month ago
bump
0 Votes
Login to post a comment