Based on the discussion of the Kylo Falcon scene, I wondered what progress has been made in modern content aware filters so I did a test in After Effects and compared it to Telecine’s work:
Keep in mind that Telecine probably used multiple approaches whereas I simply threw the shots into the machine and rendered the results. The settings were set to ‘object’ tracking, and I did a fade around the timecode of 5 pixels. I think some of these results are pretty good, all things considered. Of course, Telecine’s work is more seamless in most shots.
In particular, shots 2 and 4, the long tracking shots, are both improved in AE. There’s some trouble with both, but it’s not insurmountable. Also, shot 5 looks just about perfect to me right out of the can. This is good news to me since the moving camera shots are the hardest to work with in my traditional Photoshop approach. I think a combination of approaches would be ideal here, doing the more painstaking image replacement for static shots with elements moving past them, and content aware filters for moving camera shots.
Although, I wonder if the ‘surface’ option is better for static shots where objects move in front of the background. Used with the ‘reference frame’ option, it could be ideal.
So, has anyone else played around with this or other content-aware filters, and if so, are there any tricks you’ve found to get good results?