• Aria@lemmygrad.ml
    link
    fedilink
    arrow-up
    4
    ·
    9 months ago

    So what exactly is this? Open-source ChatGPT-alternatives have existed before and alongside ChatGPT the entire time, in the form of downloading oogabooga or a different interface and downloading an open source model from Huggingface. They aren’t competitive because users don’t have terabytes of VRAM or AI accelerators.

    • Schlemmy
      link
      fedilink
      arrow-up
      3
      ·
      edit-2
      9 months ago

      Edit: spelling. The Facebook LLM is pretty decent and has a huge amount of tokens. You can install it locally and feed your own data into the model so it will become tailor made.

    • ☆ Yσɠƚԋσʂ ☆OP
      link
      fedilink
      arrow-up
      1
      arrow-down
      1
      ·
      9 months ago

      It’s basically a UI for downloading and running models. You don’t need terabytes of VRAM to run most models though. A decent GPU and 16 gigs of RAM or so works fine.