Aces@lemmy.today to No Stupid Questions@lemmy.world · 1 year agoHas Google’s search results drastically declined for anyone else?message-squaremessage-square191fedilinkarrow-up1622arrow-down126
arrow-up1596arrow-down1message-squareHas Google’s search results drastically declined for anyone else?Aces@lemmy.today to No Stupid Questions@lemmy.world · 1 year agomessage-square191fedilink
minus-squarenotfromherelinkfedilinkarrow-up1·1 year agoI think this is because of how transformer style LLMs tokenizers work, the models don’t really understand the spelling of the words when asked like that. Karpathy has a great learning video on the GPT2 tokenizer that just came out.
I think this is because of how transformer style LLMs tokenizers work, the models don’t really understand the spelling of the words when asked like that. Karpathy has a great learning video on the GPT2 tokenizer that just came out.