Except it clearly doesn’t produce the same result every time. You’re not making a good case for whatever you’re trying to say.
Comment on Ask ChatGPT to pick a number between 1 and 100
pipows@lemmy.today 7 months ago
LMs aren’t thinking, aren’t inventing, they are predicting what is supposed to be answered next, so it’s expected that they will produce the same results every time
eluvatar@programming.dev 7 months ago
Cethin@lemmy.zip 7 months ago
They add some fuzziness to it so it doesn’t give the exact same result. Say one gets a score of 90, another 85, and other 80. The 90 will be picked more often, but they sometimes let it pick the 85, or even the 80. It’s perfectly expected, and you can see that result here with 42 being very common, but then a few others being fairly common, and most being extremely uncommon.
xthexder@l.sw0.com 7 months ago
You’re mostly right, but this graph actually shows a little more about what’s happening with the “temperature” of the LLM.
It’s actually predicting the probability of each word (token) it knows coming next, all at once. The temperature then says how random it should be when picking from that list. A temperature of 0 means always pick the most likely next word, which in this case ends up being 42.
As the temperature increases, it gets more random (but you can see it’s still not a perfect random distribution with a temperature of 1)