• acastcandream@beehaw.org
    link
    fedilink
    arrow-up
    9
    ·
    11 months ago

    “Eclipses” is a strong word to describe the relationship and there’s a reason they compared it to 3.5. Regardless, it’s impressive and exciting!

    • blindsight@beehaw.org
      link
      fedilink
      arrow-up
      4
      ·
      11 months ago

      It’s amazing how quickly this space is moving, and it’s even more amazing that a lot of these models can run on consumer hardware, too.

      I’m kinda getting FOMO that I bought an 8GB AMD graphics card last year. Maybe I should have spent a bit more to get a 24GB NVidia card and 64GB of RAM.

  • Ashyr@sh.itjust.works
    link
    fedilink
    arrow-up
    5
    ·
    11 months ago

    32k tokens seems to be approaching a usable space.

    I tried MistralOrca and, while it was impressive, the token limit prevented it from being immediately useful.