To be fair it was never referenced in any of the films before Rogue One. So if your personal canon is the films only, as mine is, then the question of his home is an open one. Well, at least until Rogue One was released anyway.
But there are multiple things we aren’t told and shown in the OT. Vader slaughtering Rebels is a perfect example.