We’re comparing this to the observable behaviors of humans, though. Humanity engages in unsupervised learning without a scoring function (let alone a differentiable one) and, as a result, can not only train on the fly, but can also find its own ways to self-evaluate its learning. Humans also have hormones which change how the brain works even further.

This is also all disregarding the ability for the human mind to become faster and more accurate on recall when it has more knowledge to search in a field. LLMs can’t recall very effectively, instead becoming less effective the more information it needs to search.