• lime!@feddit.nu
    link
    fedilink
    English
    arrow-up
    1
    ·
    19 hours ago

    in that case you’re looking for llamafiles. single file, llm included, starts into a web gui. the only limitation is that windows limits the size of executable files to 4GB so on that OS you’re limited to smaller models.

    • ipkpjersi
      link
      fedilink
      English
      arrow-up
      1
      ·
      2 hours ago

      That sounds interesting, I’ll check it out, thanks!