Color matching and prediction 2.0

So, many years ago I wrote an algorithm for matching the colors of two identical frames with different color grades. The algo has become quite popular among the community in the form of an aging color matching tool:

https://originaltrilogy.com/topic/Color-matching-and-prediction-color-correction-tool-v13-released/id/18128

Over the past year I have been working on a new algo, that does what the old algo does, and much, much more. Simply put the algo can transfer color grades between two frames that are not identical. Here’s an example, where I transferred the color grade of the cantina scene from the 2019 SE to the cantina scene in the Mandalorian season 1:

Target:

Reference:

Color match:

Here’s another example, where I transferred the technicolor color grade of the new restoration of The Ten Commandments (1956) to another classic Cleopatra (1963):

Target:

Reference:

Color match:

Finally, here’s an example, where I transferred the color grade of the Matrix (1999) to 13 Minutes (2015):

More examples are coming in the near future. So, let’s have some discussion on the subject of color matching and color grading in general…

Here’s another set of examples for the case, where you don’t have a proper color reference, but you do have production photos, that can serve as a starting point for a color grade.

The first example is the scene in ANH, where Luke first meets R2-D2 and C3-PO:

Target:

Reference:

Color match:

The second example is the scene following the torture of Han Solo in TESB:

Target:

Reference:

Color match:

The final example is our first introduction to Jabba the Hutt in ROTJ:

Target:

Reference:

Color match:

One important point to consider is, that not just any image is suitable as a reference. We’re looking for images with similar lighting, and similar content in terms of colors.

Final example for today, the algo can also handle references of let’s say questionable quality, where it will protect the shadow and highlight detail.

Here’s the scene of Tarkin refusing to evacuate matched to a photo of the same shot on a technicolor print:

Target:

Reference:

Color match:

Dang, this is incredible work Dre! Can’t wait to see progress on this. Would this new algorithm be able to handle HDR sources pre tone mapping? The previous one seemed to do fine when switching rec709 colors (put in a hdr container) to a rec 2020 source, just wondering if this would be able to work to create luts that are 12bit or 10bit friendly.

I tried out your previous version of this and just found out about you creating this version right here.

Just letting you know that I can’t wait for you to showcase some more about this tool.
I guess you also use it for your Extended Edition Fellowship of the ring restoration.

Keep up the great work. Can’t wait to maybe someday try this one out too.

This is astounding. The possible applications of this are giving me a headache.

Would love to give this new algorithm a spin when you’re open to sharing.

Your a magician. Really awesome. I’ve wish I knew more about coloring, I shit video before and adjusted a bit but this is really amazing to see the side by side. Great work. I’ve been amazed by all these remastered releases, just getting into it now.

I’ve been using your original color matching tool for years, but this looks vastly better.

Do you have any plans to release it, and if so, do you have an estimate of when?

Those examples are astounding!! And I thought it couldn’t get better than the original tool. Is there any progress on a release by any chance?

And also, I’m curious: how come your color matching tool is MILES better than the one by default in Premiere? Without divulging any secrets, what makes it so accurate and the one in Premiere so underwhelming?

I’ve been practicing color correction lately, and while I’ll download the most recent build of your color matching tool, I’ll be looking forward to this build’s release.