• TheOubliette
    link
    fedilink
    arrow-up
    3
    arrow-down
    1
    ·
    1 month ago

    Because it’s close enough. Turn off beam and redefine your state space and the property holds.

    • howrar@lemmy.ca
      link
      fedilink
      arrow-up
      4
      ·
      1 month ago

      Why settle for good enough when you have a term that is both actually correct and more widely understood?

          • TheOubliette
            link
            fedilink
            arrow-up
            2
            arrow-down
            1
            ·
            1 month ago

            But that’s so vague. Molecules semi-randomly smashin into each other is a stochastic process

            • howrar@lemmy.ca
              link
              fedilink
              arrow-up
              2
              ·
              1 month ago

              That’s basically like saying that typical smartphones are square because it’s close enough to rectangle and rectangle is too vague of a term. The point of more specific terms is to narrow down the set of possibilities. If you use “square” to mean the set of rectangles, then you lose the ability to do that and now both words are equally vague.

              • TheOubliette
                link
                fedilink
                arrow-up
                2
                arrow-down
                1
                ·
                1 month ago

                Is this referring to what I said about Markov chains or stochastic processes? If it’s the former the only discriminating factor is beam and not all LLMs use that. If it’s the latter then I don’t know what you mean. Molecular dffusion is a classic stochastic process, I am 100% correct in my example.

                • howrar@lemmy.ca
                  link
                  fedilink
                  arrow-up
                  1
                  ·
                  1 month ago

                  It’s in reference to your complaint about the imprecision of “stochastic process”. I’m not disagreeing that molecular diffusion is a stochastic process. I’m saying that if you want to use “Markov process” to describe a non-Markovian stochastic process, then you no longer have the precision you’re looking for and now molecular diffusion also falls under your new definition of Markov process.

                  • TheOubliette
                    link
                    fedilink
                    arrow-up
                    1
                    arrow-down
                    1
                    ·
                    1 month ago

                    Okay so both of those ideas are incorrect.

                    As I said, many are literally Markovian and the main discriminator is beam, which does not really matter for helping people understand my meaning nor should it confuse anyone that understands this topic. I will repeat: there are examples that are literally Markovian. In your example, it would be me saying there are rectangular phones but you step in to say, “but look those ones are curved! You should call it a shape, not a rectangle.” I’m not really wrong and your point is a nitpick that makes communication worse.

                    In terms of stochastic processes, no, that is incredibly vague just like calling a phone a “shape” would not be more descriptive or communicate better. So many things follow stochastic processes that are nothing like a Markov chain, whereas LLMs are like Markov Chains, either literally being them or being a modified version that uses derived tree representations.