using the sessionId and performing right POST actions , I can navigate inside all pages I need and that is a good thing :)
My issue :
I'm able to simulate all steps using scrapy shell and regEx (and all work fine) but I don't know how to manage these steps inside a spider before starting my extraction.
I need help about this strange scenario.
- calling site http://www.mysite,com/index.php , I can get this information from tag script
- using the key , I have to call this endpoint
for retrieving the SessionID which is inside a javascript
using the sessionId and performing right POST actions , I can navigate inside all pages I need and that is a good thing :)
My issue :
I'm able to simulate all steps using scrapy shell and regEx (and all work fine) but I don't know how to manage these steps inside a spider before starting my extraction.
Could you help me in some way ?
Thanks in advance
Luca
0 Votes
0 Comments
Login to post a comment