Other people are not important to me because I care about them (at least coworkers). They are “important” because I care how they can make my life difficult

It’s not much of an assumption. They basically said as much themselves. Autistic people can be dicks too…