Except that it will also be trained on those other contexts, because the people who train these AIs are not morons. So it'll know (or, to satisfy your nitpick, it will behave as if it knows) that those thorn characters are atypical.