Yup, too cold temp does that, and repeats the last token/word ad infinitum
Comment on stuttering search engine
EpeeGnome@feddit.online 2 months agoI couldn’t replicate it, but I’ve seen LLMs fail this way before, so it’s very plausible.
Willdrick@lemmy.world 2 months ago
TherapyGary@lemmy.dbzer0.com 2 months ago
1000014128