“Polly want a cracker” has been around since before anyone alive today was born, and that’s the same thing as what LLMs are doing, in essence, but no one was taking advice from parrots.