Running AI models without floating point matrix math could mean far less power consumption.

Running AI models without matrix math means far less power consumption—and fewer GPUs?

  • FaceDeer@fedia.io
    1·
    6 months ago

    I don’t think that making LLMs cheaper and easier to run is going to “pop that bubble”, if bubble it even is. If anything this will boost AI applications tremendously.