In the mean time, I managed to improve the color matching method. There appears to be some color noise hidden in the raw scan, that was difficult for the algorithm to handle. The new algorithm is less sensitive to the color noise. Once again the reference is the Semi-Specialised Edition V2.2 frame posted earlier:
The results are as follows (raw/rough correction/correction with algo):
