To add to the confusion, here’s what it looks like on the JSC laserdisc:
That one has the most color difference between his face, his robe, and the mountains, in addition to having a really pleasant sky. I compared these to the SSE and this shot is better than it too. Can you ask your algorithm to try and grade it to that?