Do they bundle the cost of handsets with the monthly fee and just allow you to upgrade every some number of months? But if you forget to upgrade, or don’t want to, you still pay the same?

Yes. It’s an expensive plan with a “free” phone. If you don’t re-contract or switch at the end of the term you will be massively overpaying.