Harmy said:

It's also that in some scenes the SE is too bright and it's tricky to darken it because of the crushed blacks and overblown whites.

Yeah, that was one thing Adywan ran into when making the ESB Reconstruction. Scenes like some of the Dagobah ones are way too bright, but you can't really bring the levels down without destroying the image so you have to sort of live with what is there. Brightening the image seems to be pretty easy, and luckily this is the more common fix the SE requires.