Who cares if it gets it right 99% of the time? Who cares if the next model is 99.9%? It’s not 100%! That means it’s a ticking clock until something major fucks up!

This is a really weak argument. Getting right 99.9% of the time is extraordinarily good in many fields, superhuman even. The human brain is also a non-deterministic system. Surgeons make mistakes too, there is no such a thing as a 100% reliable human.