• kamiheku@sopuli.xyz
    link
    fedilink
    English
    arrow-up
    100
    arrow-down
    3
    ·
    5 months ago

    The reality is, though, that there are no such APIs. LLMs on the other hand could be a valid tool for the use case.

    • Semi-Hemi-Lemmygod@lemmy.world
      link
      fedilink
      English
      arrow-up
      56
      arrow-down
      4
      ·
      5 months ago

      It’s not that there’s no API. It’s that there’s probably a different API for every single grocery store. And they make random changes and don’t have public documentation. That’s why we need the AI.

      • Blackmist@feddit.uk
        link
        fedilink
        English
        arrow-up
        28
        ·
        5 months ago

        The stores don’t want you to have easy comparable access to their prices.

        They’d quite like it if you just came in, saw that the item you wanted is out of stock, and then just buy some shit you didn’t need.

        • drathvedro@lemm.ee
          link
          fedilink
          arrow-up
          1
          ·
          5 months ago

          But they’ll happily give you full access to everything they have if you’re another corpo and you promise to marginally improve their sales anyhow. That’s, sadly, how businesses work.

      • FaceDeer@fedia.io
        link
        fedilink
        arrow-up
        13
        arrow-down
        3
        ·
        5 months ago

        Indeed. LLMs read with the same sort of comprehension that humans have, so if a supermarket makes their website compatible with humans then it’s also compatible with LLMs. We have the same “API”, as it were.

          • FaceDeer@fedia.io
            link
            fedilink
            arrow-up
            6
            arrow-down
            1
            ·
            5 months ago

            Yup. And those that can’t can have a parser pull just the human-readable text out, like a blind person’s screen-reader would do.

          • FaceDeer@fedia.io
            link
            fedilink
            arrow-up
            2
            ·
            5 months ago

            That sounds like an issue with your system prompt. If you’re using an LLM to interpret web pages for price information then you’d want to include instructions about what to do if the information simply isn’t in the web page to begin with. If you don’t tell the AI what to do under those circumstances you can’t expect any specific behaviour because it wouldn’t know what it’s supposed to do.

            I suspect from this comment that you haven’t actually worked with LLMs much, and are just going off the general “lol they hallucinate” perception they have right now? I’ve worked with LLMs a fair bit and they very rarely have trouble interpreting what’s in their provided context (as would be the case here with web page content). Hallucinations come from relying on their own “trained” information, which they recall imperfectly and often gets a bit jumbled. To continue using a human analogy, it’s like asking someone to rely on their own memory rather than reading information from a piece of paper.

          • Zos_Kia@lemmynsfw.com
            link
            fedilink
            arrow-up
            2
            arrow-down
            1
            ·
            5 months ago

            Or you could just prompt it to not guess prices for articles that don’t exist. Those models are pretty good at following instructions.

      • grue@lemmy.world
        link
        fedilink
        English
        arrow-up
        11
        arrow-down
        2
        ·
        5 months ago

        No, that’s why we need regulations to enforce standards.

      • Joe Cool@lemmy.ml
        link
        fedilink
        arrow-up
        6
        ·
        5 months ago

        You just need someone to do it. Here in Austria someone did it: https://heisse-preise.io

        It’s only in German and most of the prices aren’t from a public API but crawled from different sources.
        It’s open source. Nothing except greed is stopping them from providing something like this.

        • Semi-Hemi-Lemmygod@lemmy.world
          link
          fedilink
          English
          arrow-up
          3
          ·
          5 months ago

          Imagine if instead of building their own bespoke systems, grocery stores (and other places) created an open source software foundation and worked together to produce the software they needed.

          • Joe Cool@lemmy.ml
            link
            fedilink
            arrow-up
            3
            ·
            5 months ago

            I sometimes dream of such things. Less waste, better inventory, customers get to choose inventory based on their wishlist, better prices, then I wake up.

            We actually have a small liquor store nearby that really puts stuff on the shelves if you casually mention something you like. But that’s more the exception than the rule.

        • MacN'Cheezus@lemmy.today
          link
          fedilink
          English
          arrow-up
          1
          ·
          5 months ago

          That’s impressive, and honestly looks like it was quite a bit of work. I wonder how the author finances himself? There doesn’t even seem to be a donation button on the site. I found a lengthy article on Wired but it doesn’t appear to mention how he can afford to do all of this for free.

          It’s open source. Nothing except greed is stopping them from providing something like this.

          Nothing is stopping anyone from doing this except the amount of work it takes to write and maintain all those data import scripts. I think greed is the wrong word here. It’s not unreasonable to expect some sort of monetary reward for providing a useful public service that actually helps people save money. Everyone’s gotta eat, right?

      • MacN'Cheezus@lemmy.today
        link
        fedilink
        English
        arrow-up
        1
        ·
        5 months ago

        Actually, you’d be surprised. Instacart has up-to-date price and product data for TONS of grocery stores. And while their API likely isn’t public, they MUST have one in order for their smartphone apps to work.

    • Daxtron2@startrek.website
      link
      fedilink
      arrow-up
      14
      arrow-down
      1
      ·
      5 months ago

      LLMs are not a good tool for processing data like this. They would be good for presenting that data though.

      • Sotuanduso@lemm.ee
        link
        fedilink
        English
        arrow-up
        4
        arrow-down
        1
        ·
        5 months ago

        Make an LLM convert the data into a standardized format for your traditional algorithm.

        • Daxtron2@startrek.website
          link
          fedilink
          arrow-up
          2
          ·
          5 months ago

          There’s no way to ensure that data will stay in that standardized format though. A custom model could but they are expensive to train.

        • Daxtron2@startrek.website
          link
          fedilink
          arrow-up
          6
          ·
          5 months ago

          Not if you want to ensure the validity of the compiled coupons/discounts. A custom algorithm would be best but data standardization would be the main issue, regardless of how you process it.

          • GBU_28@lemm.ee
            link
            fedilink
            English
            arrow-up
            2
            arrow-down
            2
            ·
            edit-2
            5 months ago

            What does validity mean in this case? A functionary LLM can follow links and make actions. I’m not saying it’s not “work” to develop your personal bot framework, but this is all doable from the home PC, with a self hosted llm

            Edit and of course you’ll need non LLM code to handle parts of the processing, not discounting that

            • Daxtron2@startrek.website
              link
              fedilink
              arrow-up
              1
              ·
              edit-2
              5 months ago

              The LLM doesn’t do that though, that the software built around it that does that which is what I’m saying. Its definitely possible to do, but the bulk of the work wouldn’t be the task of the LLM.

              Edit: forgot to address validity. By that I mean keeping a standard format and ensuring that the output is actually true given the input. Its not impossible, but its something that requires careful data duration and a really good system prompt.

    • zalgotext@sh.itjust.works
      link
      fedilink
      arrow-up
      8
      arrow-down
      2
      ·
      5 months ago

      there are no such APIs

      Yes there are. You can obtain access to the Kroger API, the Meijer API, the Walmart API, and I’m sure others that I didn’t bother to Google. Failing getting access to the actual APIs, there are tons of web scraper projects that just parse those stores’ websites for product information, and web scrapers are still orders of magnitude more efficient than LLMs.

      • MacN'Cheezus@lemmy.today
        link
        fedilink
        English
        arrow-up
        1
        ·
        5 months ago

        Instacart has prices for all of these stores and more. Obviously they’re not updating them by hand…

    • Ibaudia@lemmy.world
      link
      fedilink
      English
      arrow-up
      7
      arrow-down
      2
      ·
      5 months ago

      At the cost of huge amounts of wasted energy and the whole litany of concerns that are always co-morbid with AI, but technically yes they could work for this lol. Ideally we’d have standardized APIs and mandated pricing transparency, but unfortunately we live in a capitalist society where that will literally never happen ever.