Comment on OpenAI admits AI hallucinations are mathematically inevitable, not just engineering flaws
kubica@fedia.io 1 week ago
I don't know where I read it but sort of said that it to have that much information inside the models it was basically similar to a compression algorithm.
From logic, if we have a lossy compression then its mostly luck if the output is equal to the original. Sometimes it will tip one way and sometimes the other.
arthur@lemmy.zip 1 week ago
With the caveat that there is no LLM where the “compression” is lossless on this analogy.