OK, bad news.
I started editing and tried to export the first five minutes and found out that the video gets randomly one frame off. So sometimes, when I cut out frames or shots to colour correct them separately from the rest (eg. the flash frames), when rendered, the actual edit occurs one frame off from what I see on my timeline, thus applying the colour correction to a wrong frame, totally ruining it. This issue will only get to be even more of a problem when cutting in the despecialized shots, because then I could get one SE frame at the beginning or end of the despecialized shot.
The only way I could find, that might make sure this doesn't happen was using only uncompressed video for the editing. But that I simply cannot do, since I have big trouble fitting even the 15GB 720p mp4 file from You_Too that I'm currently using along with all the despecialized clips on my hard-drive.
But unless I somehow solve this issue, there's no point in continuing :-(
So any advice would be appreciated.