Hello fellow self-hosters! I am looking for an app/tool/macro/etc that can screen-scrape or API ping various merchants to track prices on specific products. Think camelcamelcamel but for any merchant. I have to believe such a tool exists and I’m not the first person to think of it.

In an ideal world, I’d like it to be able to dump the data into a spreadsheet so that I can track/graph it. But that’s not a requirement.

Does such a tool exist?

Thanks!

  • WistfulEnglish
    2·
    11 months ago

    I used browser extension Distill in the past, it’s pretty easy to use and it works well for detecting/tracking changes of the specific elements on the page. I think free version allows 25 local monitors.

    I also just found this extension Automa, I’ve never used it, but it seems cool. Looks like a Tasker for your browser. And there are also a workflows that people share, I saw this one randomly, Scrap Google Suggest to SpreadSheet so I guess you could do a similar thing for prices.

    • CosmicTurtle@lemmy.worldOPEnglish
      1·
      11 months ago

      Yeah I saw the Google sheets scraping tool and that looked promising but I don’t want to have to rely on Xpath since it could change.

      Right now I’m leaning toward change detector but can’t get the reverse proxy to work.