Your primary residence is a poor investment for several reasons, but the biggest concern is that the investment is not properly diversified.

All that money behind a single home, in a single location, subject to the local regulations, neighbors, climate conditions etc. carries significant idiosyncratic risk that is not compensated for by a corresponding risk premium. You are not paid for taking on avoidable and unnecessary risks, like betting on just one home, when institutional investors can own thousands and diversify away those investment-specific risks. You accept a much higher variance in outcomes for no additional expected value.