Yeah, these models take a lot of juice to run unfortunately. Until either hardware gets a lot cheaper, or models get a lot more efficient it’s going to be prohibitive for most people to run them locally. Stuff like pruning is actually really promising on the latter front.
Actually writing code 🙃
alternative automated plagiarism engine?
CodeGeeX 14B (pronounced ‘code-geeks’) by Tsinghua. 850B tokens for 14B params (open weights, non-commercial).
Website: https://codegeex.ai
Demo: https://huggingface.co/spaces/THUDM/CodeGeeX
Repo: https://github.com/THUDM/CodeGeeX
https://github.com/fauxpilot/fauxpilot
I look forward to trying it in a decade when RTX 3080 are cheaper.
Yeah, these models take a lot of juice to run unfortunately. Until either hardware gets a lot cheaper, or models get a lot more efficient it’s going to be prohibitive for most people to run them locally. Stuff like pruning is actually really promising on the latter front.
Codeium
Playground
Video example
Vim/Neovim plugin