Comment on What is a good eli5 analogy for GenAI not "knowing" what they say?
Drummyralf@lemmy.world 1 month agoInteresting thoughts! Now that I think about this, we as humans have a huge advantage by having not only language, but also sight, smell, hearing and taste. An LLM basically only has “language.” We might not realize how much meaning we create through those other senses.
CodeInvasion@sh.itjust.works 1 month ago
To add to this insight, there are many recent publications showing the dramatic improvements of adding another modality like vision to language models.
While this is my conjecture that is loosely supported by existing research, I personally believe that multimodality is the secret to understanding human intelligence.