Besides, it’s not like Luke would remember the place he was born at.
I know it’s cheap but, THE FORCE!
I assume such a force sensitive planet as Dagobah would leave a lasting impact on someone born there. Especially if the person themselves were connecting with the force, the long forgotten ‘aura’ of the planet would likely seem familiar.
That was the most hippie / nerdy bullshit I’ve ever said.