A challenge game developers have talked about with integrating LLMs is keeping the dialogue matched to the game world, e.g. you don’t want a Skyrim NPC mentioning a cell phone.