1-bit LLMs Could Solve AI’s Energy Demands
spectrum.ieee.org
“Imprecise” language models are smaller, speedier—and nearly as accurate
  • gramathy
    2·
    6 months ago

    Makes me wonder how much correlation there is between “good enough” hardware emulation (e.g. old consoles) and “good enough” language models in terms of effort and computational demands