I think it depends on level of passion. I'm passionate about the 1977 film and story, but not about Lucas' thoughts beyond that. My passion is the EU, primarily Zahn. That's why it was easy for me to ignore the last two films and the SEs. I went to the theater to see Phantom out of curiosity. It was shit, curiosity answered, I moved on.

To further the example; I'm a lifelong 007 nerd. MUCH more so than Star Wars. Because the passion is so deep for the story and characters, I can't imagine not going to the theater to see every film. How I feel about some of them individually doesn't change the passion.

I'd say pick your battles, but truthfully, it shouldn't be a battle. It should be an escape to a pleasant experience.

*edit*

The way I worded the above statement makes it sound as though my preference for Zahn EU figured into my feelings about post-77 Star Wars. For the sake of clarity and for any new members; My love of Zahn EU came long after I'd said goodbye to post-80s Star Wars. In fact, it's really what brought me back to the franchise.