Username: WebAutomation
Posted: 3 days ago
Want to trigger automations based on data scraped from websites (like stock prices, weather, etc). Whats the best approach for this? Should i write custom scrapers or are there services that make this easier? Need it to be reliable and not break when websites change.

Reply by: ScraperPro
For common data like weather and stocks, use apis instead of scraping - much more reliable. Most services have free tiers. For sites without apis, beautifulsoup in python works great but yes, scrapers break when sites change. Consider using selenium if the site uses javascript heavily. Another option is to use a service like parsehub or octoparse that handles the scraping for you. They auto-adapt to some site changes which is nice.