This looks phenomenal! I can't believe how clean it looks - so I'd say, that's easily enough practical clean-up on your part.

Do you already have plans how you're going to release this? I'd vote for an full-frame 1080p video (basically at the wrong AR but without the black bars), so that there's enough area to work with. This could be the release for the "tinkerers", which can be used for color-correction and clean-up, and finally resized to the correct aspect ratio. Judging from the softness, the final output could be a nice 720p video.