I've been somewhat like Anchorhead over the past couple of years. I enjoy the GOUT. On principle, it's annoying, but actually watching it is still as amazing as ever. I have a high-def screen, and it doesn't look amazing, but it's definitely still watchable, and it's the only official release with the "Episode IV: A New Hope," and I love that it lacks that.
Then again, it's not perfect. Only the ESB GOUT doesn't pull me out. For Star Wars and ROTJ, I get pulled out in the subtitle sequences. Overly pixelated and outside of the frame (and, when watching it on zoom on my high-def monitor... outside of the screen!). Forget the dupe grain (well... don't forget it)... to me, this is the biggest problem with all the Star Wars DVDs! When Greedo confronts Han, I want it to feel like Greedo's lines are a part of the movie, not something my DVD kindly decided to add in as an afterthought. But again, that's a problem with all the Star Wars DVDs, not just the GOUT. Whoever decided that was a good idea needs to get his head out of his ass.
As for the garbage mattes, something does need to be done about them. I don't want them removed. As far as I've heard, they weren't originally visible in theatres (and I don't recall seeing them in the SE theatrical presentation), so a good restoration with a proper adjustment of black levels should (mostly, at least) take care of that problem.
Oh, and a good cleanup from proper elements would be nice, too. ^_^ That would be my ideal release.