Here are the results of a few more tests. First test was to increase the image pool size. From 4/sec to 12/sec. And there is a pay off as the edge definition of the original on frame objects improves. The sky becomes a little more blocky though.
Original (4/sec) - 32000 Frames
New (12/sec) - 95830 Frames
Full Size: http://noneinc.com/SWxTPM-4DWHUXGA/SWxTPM-WHUXGA_32x32x95830.jpg
And figured might as well see what happens when the other movies get added, so here's a test at 8/sec with TPM and AotC.
Full Size: http://noneinc.com/SWxTPM-4DWHUXGA/SW4D-(8)_TPM-AotC.jpg
Cutting back to 8 from 12 affects the edge quality. But internal definition, gradated areas, improve. Luke's got eyes sockets now. But the overall face because the program is chosing color over composition seems to have suffered.
Had been letting the program run at night, but would often crash, so need to babysit and save every so often so the processing calculations aren't lost completely. 6 hours or so per frame.
So current thinking is as a proof of concept, do this one scene from SW, Luke and the twin suns. Start with original footage, then fade/convert to just TPM mosaic interpretation, then add in the other two movies. 30 seconds or so.