floofloof@lemmy.ca to Technology@lemmy.worldEnglish · 6 months ago1-bit LLMs Could Solve AI’s Energy Demandsspectrum.ieee.orgexternal-linkmessage-square35fedilinkarrow-up1113arrow-down112cross-posted to: models@lemmy.intai.techartificial_intelhackernews@lemmy.smeargle.fans
arrow-up1101arrow-down1external-link1-bit LLMs Could Solve AI’s Energy Demandsspectrum.ieee.orgfloofloof@lemmy.ca to Technology@lemmy.worldEnglish · 6 months agomessage-square35fedilinkcross-posted to: models@lemmy.intai.techartificial_intelhackernews@lemmy.smeargle.fans
minus-squaredavidgro@lemmy.worldlinkfedilinkEnglisharrow-up10arrow-down1·6 months agoBut since it takes 10% of the space (vram, etc.) sounds like they could just start with a larger model and still come out ahead
But since it takes 10% of the space (vram, etc.) sounds like they could just start with a larger model and still come out ahead