I’m interested in hosting something like this, and I’d like to know experiences regarding this topic.

The main reason to host this for privacy reasons and also to integrate my own PKM data (markdown files, mainly).

Feel free to recommend me videos, articles, other Lemmy communities, etc.

  • The Assman@sh.itjust.worksEnglish
    21·
    10 months ago

    Don’t get me wrong, I use copilot and it’s super handy, especially for menial things. I just don’t have all day to wait for a local llm to spit out an answer.

    I was using ollama + code llama + continue extension in vscode. The answers are pretty decent, but yeah, too slow and no inline suggestions. I think (not an expert) a machine with a graphics card would be more performant, but we can’t just build a suitable pc for 100 engineers.

    I also don’t own the code so privacy isn’t my concern lol so copilot suits my needs just fine.