You are correct in that a computer is only as smart as its programming. The way an LLM works is essentially just a chatbot with tons of “if, then” decision trees. You can feed it all the correct facts you want; it’s not programmed to spit out accurate facts, it’s programmed to spit out something that looks like it was written by a human. So it can, and will, say stupid shit pretty frequently.