My guess would be that as people lost their homes, they started to inhabit places like that like the homeless founder bridges and such these days. Well, not the pyramids so much, but the colloseum definitely. It likely then became dangerous to be in that area. So they kept the structure up the best they could but weren’t worried about part that didn’t provide cover from weather.