add/remove command with selective scraping "SYNC SCRAPING

Posted almost 7 years ago by vaughnservices

Post a topic
Un Answered
v
vaughnservices

 "Job Search Board" for example

Can you add instructions to the scrapper:

-Scrape all the requested items except "these"

"These" 'items' are already in your database so you're not wanting to duplicate info.

 Add command

Remove any data from database that is no longer in search results

 Remove command

The intention is to have the database to synchronize with the website every time it performs a scrape

0 Votes


0 Comments

Login to post a comment