Aces@lemmy.today to No Stupid Questions@lemmy.world · 9 months agoHas Google’s search results drastically declined for anyone else?message-squaremessage-square192fedilinkarrow-up1622arrow-down126
arrow-up1596arrow-down1message-squareHas Google’s search results drastically declined for anyone else?Aces@lemmy.today to No Stupid Questions@lemmy.world · 9 months agomessage-square192fedilink
minus-squarenotfromherelinkfedilinkarrow-up1·9 months agoI think this is because of how transformer style LLMs tokenizers work, the models don’t really understand the spelling of the words when asked like that. Karpathy has a great learning video on the GPT2 tokenizer that just came out.
I think this is because of how transformer style LLMs tokenizers work, the models don’t really understand the spelling of the words when asked like that. Karpathy has a great learning video on the GPT2 tokenizer that just came out.