OK, I'm doing it now this way
1) AviSynth - cropping the black bars + stabilizing with deflicker + removing every second frame
2) Manual cleanup of most noticable damage
3) Video filters
4) last modifications (if needed)
I'll post some screenshots as soon as I have something interesting