I think losing a little detail is worth it if it means seeing absolutely nothing but the action on the film (unless, of course, the grain is part of the movie's "style"). That's what was so fantastic about the PT, RotS in particular: That mother was clean as a whistle. It looked like there was literally nothing between you and the actors. Normally you need cheap red and blue glasses to do that. So yes, grain is, and will forever remain, my enemy.

Besides, the more sophisticated grain-removal technology (like they used for the OT DVDs) results in virtually no loss of detail at all. Then again, that's because ILM spent a Hell of a lot of money on those films, but the process will cheapen over the years.