I’d say you’re no asshole at all, cause 1) generally speaking, you can have your reasons for being distant with people, it’s not a duty or anything, 2) from the bits of context, you may be experiencing a difficult/complex/unsettling situation, which would be a good reason to keep to your personal space to my eyes and 3) i find that, paradoxically, it feels more ok to have a “negative” or “not positive” or “neutral” behavior towards people who are more or less comprehensive/supporting, which seems to be the case here. On one hand we could feel like, since they make move towards us, we should thank them or they should be rewarded with extra attention, but on the other end, it’s the ideal situation to be reserved or less considerate without hurting people.