I think he means the apartment building, it would be weird if he could find his way into someone’s home without realizing it