Get your idea to 2 to be reviewed
- 1Schedule scrapingUsers can currently set what to scrape, but not when. Add functionality so that users can set their scraper to run every x days at y time, for example.
- 1Scrape InstagramScrape URLs based on specific filters. For example, scrape IG profile URLs with specific bio's, or followers of a certain influencer.
- 0Let async/js stuff load then try scrape the pageIs there a way you can add an option to delay once a page has been requested to let async/javascript stuff load then try scrape the page?