I’d recommend practicing being direct, polite, and consistent. In the end you can’t control his actions but you can control yours. If you need help then get help from a capable coworker or manager. Don’t waste any time or energy feeling bad about it.