You? No. It’s not something you did.

Personally I find this fucked up. Especially the way it’s written, but I can’t expect anything else from someone who sets up dates for others without their permission.
This is not the same as buying you some snacks that were on sale, but seems to be taken as lightly from him.

I imagine the comments here would be quite different if you were a woman.

If you feel comfortable with it, then go ahead. But keep in mind you don’t know how it’s arranged on the other side, and the other party may not. Well, just the usual “be nice”.