“Im not going, this is personal!”

Familly trying to rip you up through their petty grudges is fucked up. Its not easy but i think its time to communicate boundaries with your brother and your mother.