Okay, let's agree to disagree. I also have three very distinct memories from being just under two years old, and I can remember where they were and who was in them, but I still don't have a problem with the Leia dialogue because I'm not taking it too literally.
Leia never recalls a single actual memory of her mother, so to me that is perfectly fine. Anyway, moving on...