House seems real. Here is a youtube short of a guy walking through it and an Architectural Digest article about the house, its history, and its transformation to the drab and now even more giant state it is in. I turned off javascript and was able to read the whole article. It also talks about how most of the filming was offsite, as you said.

Current owner says they wish to restore the interior.