Any good open source projects that do this?
I’ve see MLC-LLM, but their last release was a year ago and it’s not clear how their android app was made[0].
There’s also MLLM, which has an impressive github demo page, but surprisingly few issues or contributers, also leaving to me to think it might not be real[1].
Does anyone have any local LLM providers on their phone that they trust?
One option of course is to run ollama through Termux, but I want a more appified experience.
I briefly tried Maid: https://github.com/Mobile-Artificial-Intelligence/maid
But I think most people use Termux plus some regular Linux project. Or a remote service. I mean this is a niche. Most people don’t own a beefy phone that’d accomodate for a decently sized LLM.
And as a warning: Lots of Lemmy users are tired of reading AI posts. Don’t be surprised if you get downvoted here. You’d be better off asking in some of the dedicated AI communities.
Thanks for feedback, and the links!
