Yeah, removing the "oops, close talker Vader" thing isn't something I'd suggest either. Removing it will just take out one more fun thing about the Trilogy we all enjoyed (like "fixing" the stormtrooper head bump, which is far less subtle than this).
***
Vader's attitude in his search for Luke, the opening crawl, and his dialog with the Emperor were fine in 1980. You can sense that Vader's underlings are all thinking their boss is a bit crazy, but most of them are too scared of him to object (note Ozzel's near condescending attitude "My Lord, there are so many uncharted settlements,... it may be smugglers...). That's kind of a cool thing, and it extends into ROTJ ("It's an older code sir, but it checks out, I was about to clear them..." and the awkward pause as Vader reaches out with the Force to sense Luke). Perfect. That's the sort of thing Lucas would screw up if he thought of it, so please leave it be!
Adywan's decision to use the ROTJ Emperor (instead of the pickup shots from Episode III that Lucas clumsily inserted in 2004) with the McDiarmond dialog is fine, and actually looks decent. The only way to make it perfect would be to get the actor saying "Luke."
I am totally against anything that would connect ESB's badass Vader with the weak willed, whiny brat that Hayden plays in Episode II and III. No references to Padme, no extra dialog please!
As for all the stuff about recoloring ships.. it's getting way out of hand. I urge you to not modify the color of the Executor. It looked great in 1980 as this big dark badass ship. It isn't just a regular Star Destroyer that's been inflated, no matter what some stupid EU source says (which gets the size wrong anyway). Aligning all the ships so they all look the same and fly the same and are lined up just makes it look more fake. The only ships that ever "flew in formation" were the TIE Fighters. The battles in Star Wars are not like the "ship of the line, age of sail" type battles in Star Trek (the "broadsides" in Episode III's battle of Coruscant nonwithstanding), but would be more akin to a cross between submarine and aircraft carrier/battleship warfare of the 20th century.
Making everything a shade of gray is just as bad as making everything blue like the 2004 editions did. It just turns the movie drab. I have nothing against black and white film, but that was one thing about ANH:R that looked a bit off... having a color element or two floating on a black and white background (I realize ady tried his best with what he had since so much of the color had faded... I would have suggested using overlays from the GOUT to get the colors as good as possible).
But in the end, the colors ought to look like a restored theatrical edition, not modified to meet someone's fanboy expectations of how it should look (expectations that are largely colored by reading too many EU comics and playing too many EU video games).
Hey, at least no body is arguing that the Ion Cannon shot should be blue! (and before you say it, no, that's a TERRIBLE idea!).
There's no need to come up with more work for ady, just to make the project take a long time and remake the film. As so many have said, ESB is already a great movie and doesn't "need" much work on it at all compared to the rest. A proper restoration to undue the damage done in the 2004 edit, and a rollback on the dumber changes made by Lucas in 1997... beyond that, fixing SFX glitches is really all that needs to be done. People are cool with their ideas, but it's like they're going out of their way to see what COULD be changed (not that really needs to be). Just a nitpick there.