• WalnutLum
    link
    fedilink
    English
    arrow-up
    1
    ·
    5 months ago

    ChatGpt already is multiple smaller models. Most guesses peg chatgpt4 as a 8x220 Billion parameter mixture of experts, or 8 220 billion parameter models squished together