Yup, too cold temp does that, and repeats the last token/word ad infinitum
Comment on stuttering search engine
EpeeGnome@feddit.online 4 weeks agoI couldn’t replicate it, but I’ve seen LLMs fail this way before, so it’s very plausible.
Willdrick@lemmy.world 4 weeks ago
TherapyGary@lemmy.dbzer0.com 4 weeks ago
1000014128