It wouldn’t be any different if you did the same with a human brain (with the memory capacity of ChatGPT):

“Human, read and memorize this giant pile of written text, which is a mix of things on the Internet, almost every book ever written, and such things.”

“OK, have done that.”

“Now, based on what you’ve read, tell me: Who is Barack Obama?”

“Barack Obama is a man born in 1961 who was the US president from 2009 to 2017. [… other facts about Obama that were somewhere in the training data]”

“OK, and who was Konrad Adenauer?”

“Konrad Adenauer was the first federal Chancellor of the Federal Republic of Germany. [… other facts about Adenauer that were somewhere in the training data]”

“OK, what’s the current date and time?”

“No idea. How am I supposed to know THAT?”