I was never really interested in any of the "expanded universe" stuff.
The only book I read was the novelization of the original Star Wars. I have never bought any action figure and never heard the radio drama (or dramas?). I have never read any of the comics or novels, I simply thought it's a waste of time and to be honest, I thought the people who spend their time trying to collect all Star Wars information are - to say it politely - slightly weird :-)
But then I've seen the Clone Wars movie and I really liked it. I started to find out that I missed quite a lot of the officially released things. I started to watch the CG series this week, and I REALLY enjoy it very much. I guess I'm getting more and more nerdy :-)
But I fully agree with you, life was so easier when there was just one Star Wars trilogy. Less can be really sometimes more