Yup, too cold temp does that, and repeats the last token/word ad infinitum
Comment on stuttering search engine
EpeeGnome@feddit.online 1 month agoI couldn’t replicate it, but I’ve seen LLMs fail this way before, so it’s very plausible.
Willdrick@lemmy.world 1 month ago
TherapyGary@lemmy.dbzer0.com 1 month ago
1000014128