MeDuViNoX@sh.itjust.works to Technology@lemmy.worldEnglish · 7 months agoGemini doesn't share Google search's AI advice on pizza cheese solutions?sh.itjust.worksimagemessage-square41fedilinkarrow-up1455arrow-down125
arrow-up1430arrow-down1imageGemini doesn't share Google search's AI advice on pizza cheese solutions?sh.itjust.worksMeDuViNoX@sh.itjust.works to Technology@lemmy.worldEnglish · 7 months agomessage-square41fedilink
minus-squareistanbullulinkfedilinkEnglisharrow-up1·7 months agohttps://github.com/ollama/ollama/blob/main/docs/api.md#request-reproducible-outputs LLMs are prompted with a seed. If you change the seed you get a different answer.
minus-squareTurun@feddit.delinkfedilinkEnglisharrow-up1·7 months agoAddendum: The docs say For reproducible outputs, set temperature to 0 and seed to a number: But what they should say is For reproducible outputs, set temperature to 0 or seed to a number: Easy mistake to make
minus-squareTurun@feddit.delinkfedilinkEnglisharrow-up1·7 months agoI appreciate the constructive comment. Unfortunately the API docs are incomplete (insert obi wan meme here). The seed value is both optional and irrelevant when setting the temperature to 0. I just tested it.
https://github.com/ollama/ollama/blob/main/docs/api.md#request-reproducible-outputs
LLMs are prompted with a seed. If you change the seed you get a different answer.
Addendum:
The docs say
But what they should say is
Easy mistake to make
I appreciate the constructive comment.
Unfortunately the API docs are incomplete (insert obi wan meme here). The seed value is both optional and irrelevant when setting the temperature to 0. I just tested it.