It would be better not to use plastic at all, yeah. They definitely leach plasticizers from the polymer into the water, even if they’re BPA free. My standard bottle is stainless steel. I’ve heard good arguments for glass, but it’s too fragile for me. Aluminum bottles usually have a plastic liner. Nothing is perfect. I just try to limit waste and reduce harm.