Without them, the house just isn't a home anymore. He didn't have any reason to stick around.