Lee Duna@lemmy.nz to Technology@lemmy.worldEnglish · 8 months agoWant a more private ChatGPT alternative that runs offline? Check out Janbgr.comexternal-linkmessage-square80fedilinkarrow-up1417arrow-down117
arrow-up1400arrow-down1external-linkWant a more private ChatGPT alternative that runs offline? Check out Janbgr.comLee Duna@lemmy.nz to Technology@lemmy.worldEnglish · 8 months agomessage-square80fedilink
minus-squareInfiltrated_ad8271@kbin.sociallinkfedilinkarrow-up14arrow-down2·8 months agoThe question is quickly answered as none is currently that good, open or not. Anyway it seems that this is just a manager. I see some competitors available that I have heard good things about, like mistral.
minus-square🇸🇵🇪🇨🇺🇱🇦🇹🇪🇷@lemmy.worldlinkfedilinkEnglisharrow-up5·8 months agoI think a good 13B model running on 12GB of VRAM can do pretty well. But I’d be hard pressed to believe anything under 33B would beat 3.5.
minus-squarealphafalcon@feddit.delinkfedilinkEnglisharrow-up5·8 months agoB stands for Billion (Parameters) IIRC
minus-squarejune@lemmy.worldlinkfedilinkEnglisharrow-up3arrow-down3·8 months ago3.5 fuckin sucks though. That’s a pretty low bar to set imo.
The question is quickly answered as none is currently that good, open or not.
Anyway it seems that this is just a manager. I see some competitors available that I have heard good things about, like mistral.
Local LLMs can beat GPT 3.5 now.
I think a good 13B model running on 12GB of VRAM can do pretty well. But I’d be hard pressed to believe anything under 33B would beat 3.5.
deleted by creator
B stands for Billion (Parameters) IIRC
3.5 fuckin sucks though. That’s a pretty low bar to set imo.