In what way is he your boyfriend? He doesn’t sound like he is. Poly is really hard, and it’s full of shitty people who use it as a justification for being shitty. Sounds like you need to do a whole bunch of work on yourself right now, and it doesn’t really sound like either of your “partners” are good for you.