Turn your computer into an AI computer - Jan
jan.ai
Run LLMs like Mistral or Llama2 locally and offline on your computer, or connect to remote AI APIs like OpenAI’s GPT-4 or Groq.
  • lawrence@lemmy.worldOP
    4·
    6 months ago

    I tested some of these open source projects. The main interesting points I identified in Jan were:

    • Desktop application, not web-based. No need to install or configure anything else.
    • The selection and download of the models you want to use are done entirely within the program. As easy as installing a plugin.
    • User-friendly interface, keeps a history of the “conversations”.
      • wagoner@infosec.pub
        2·
        6 months ago

        How does a non programmer know whether to trust that offerings like LM studio are truly offline and can be trusted?

        • chicken@lemmy.dbzer0.com
          2·
          6 months ago

          For a simple test that it is running offline, unplug your internet before chatting (after downloading the model). However if trust is a big concern, you might want to go with something popular and open source so you know third party devs have an eye on the code, which afaik LM Studio is not open source since there isn’t much code on their github.