It is not about how you remember the movie, it is about how you remember what the movie meant to you and the times you had with it as a kid. No matter what, my memories of playing Star Wars with my friends as a kid, or the countless times I watched the films and loved them, or how much money I spent on everything with the name "Star Wars" on it when I was a kid, go on unchanged. That is why the term "raped my childhood" is absurd as Tip pointed out. The movies are altered, but my childhood is untouched, even if I don't remember every single detail of those childhood experiences. Even if I have a hard time remembering the film exactly as it was before the alterations (which actually isn't hard, I have only seen the 2007 SEs once or twice each, and have never seen the 04 SEs at all), it still has no effect on my childhood.

If Lucas were to invent a time machine, and go back to my childhood years and do something to all my Star Wars toys and then do unspeakable things to me so that I could never enjoy my childhood again, then I could claim that the man raped my childhood, but until he goes that far and does this to one of us, I think it is a stupid, overly hyperbolic term to use.