If you say that "look at how much money I'm making, tax me harder daddy" it's another.

That is a bad thing for affordable housing. For affordable housing you need profits from investment property just enough to be worth doing. Any taxes a property owner pays needs to come from the rent they charge so high taxes mean they are charging more rent to cover it. So if taxes are high that means that rents are higher than they could be. You should get rich - to the extent you do - in property ownership by owning a lot of property for a long time, not charging high rents.