Sadly I’m lacking in any experience in terms of colorizing video, but I have done individual frames before…
I don’t know much about motion tracking, tho I assume if I just save my color values used, I could just do each frame from scratch (although I guess the unchanging backgrounds of shots with a still camera could just have color adjustments painted the same across frames.
I don’t have a SW example sitting around, but maybe I could try it sometime soon.
Here’s a test I did with an I Love Lucy still a couple months back. With SW tho, I could probably copy color values over from the other color scenes, so you might get more accurate and realistic colors.