Could be any number of things. Bringing back memories he doesn’t want, mistaken identity, jealous SO. Anyone on here can only guess. Your best avenue is people you mutually know, assuming that wasn’t his way of definitively telling you he wants to be left alone.