Yup, too cold temp does that, and repeats the last token/word ad infinitum
Comment on stuttering search engine
EpeeGnome@feddit.online 3 months agoI couldn’t replicate it, but I’ve seen LLMs fail this way before, so it’s very plausible.
Comment on stuttering search engine
EpeeGnome@feddit.online 3 months agoI couldn’t replicate it, but I’ve seen LLMs fail this way before, so it’s very plausible.
Yup, too cold temp does that, and repeats the last token/word ad infinitum
shivering…
TherapyGary@lemmy.dbzer0.com 3 months ago
1000014128