• WalnutLum
    link
    fedilink
    English
    arrow-up
    4
    ·
    6 months ago

    The problem is notably “powerful”, AIs need pretty significant hardware to run well

    As an example the snapdragon NPUs I think can barely handle 7B models.