- Post
- #772040
- Topic
- Star Wars GOUT in HD using super resolution algorithm (* unfinished project *)
- Link
- https://originaltrilogy.com/post/id/772040/action/topic#772040
- Time
Yep, the video sample should be online in a few days.
Yep, the video sample should be online in a few days.
Here's one of those notoriously grainy shots on Tatooine and how it will be handled by SRV10:
To ease the fears about those lightsabers, here's an example:
One of the problems is that many of the scripts and filters in Avisynth work in different color spaces, so there are a number of color space conversions. I've reduced the number of conversions to the least possible, but there are still a few. The worst of these is the YV12 conversion, which seems to be the main reason for the dimmed colors. I'll merge the chroma channel of SRV10 with the Spline64.
Edit:
I actually found a different way to correct the colors. Here's what frame 4961 and 7218 look like with the correct colors compared to the Spline64:
I think that's more to do with deblurring. The red lights, but also the black lines are pretty blurry in the Spline64.
The eta is as soon as possible. The rendering takes about two weeks, which would be fine, if not for the fact that I had to start over with each iteration. ;-)
I do think this may be a good time to get a version out there, such that you can judge it's merits, which can be used as input for another version in the future.
@Danfun128
Who's being offended? I think the bluray stinks to high heaven. However, having seen the samples I thought it very unlikely that the 35 mm LPP would beat the bluray in terms of detail, but since the video samples are compressed and the ESB Grindhouse looked very good, I was curious how the team would rank it. That's not such a weird question.
I will try to create a video sample as soon as possible.
1920-wide upscales are possible, only it won't add much in terms of detail, so an HD-TV's internal upscaler will probably approach the same quality.
Thanks for th compliments! Not sure if I'll be able to squeeze any more out of this. :-P
Thanks! Wouldn't have been possible, if it weren't for the great feedback you guys (and maybe a girl or two) have been giving...
How I did it? I combined edge directed interpolation with super resolution in my script.
Actually, the ringing was much worse originally. Here's a comparison for the frame with an ancient super resolution version:
http://screenshotcomparison.com/comparison/128260
Here are a few more comparisons. This time to the simple upscale:
http://screenshotcomparison.com/comparison/128261
http://screenshotcomparison.com/comparison/128262
http://screenshotcomparison.com/comparison/128263
http://screenshotcomparison.com/comparison/128264
http://screenshotcomparison.com/comparison/128265
I have a question, if you were to compare the 35 mm preservation to the 2011 bluray how would you rank it in terms of detail on a scale from 0-100 (the bluray being 100)?
Here are a few comparisons between SRV9 and SRV10, including the notorious C3PO and R2D2 frames. Aliasing is now greatly reduced, while retaining the detail, as is evident from the 4th and 5th comparisons.
http://screenshotcomparison.com/comparison/128244
http://screenshotcomparison.com/comparison/128245
http://screenshotcomparison.com/comparison/128248
http://screenshotcomparison.com/comparison/128250
http://screenshotcomparison.com/comparison/128251
It appears super resolution v10 will solve the problem of aliasing for the most part. Screenshots will follow soon.
Here's the first video sample for SRV9. As before, it's the first 10 min of the film.
Video removed
Here's a comparison for Team Blu vs MagicSR V9:
http://screenshotcomparison.com/comparison/128071
I think a close inspection reveals MagicSR retains more detail, while still effectively removing aliasing.
Edit:
I think the difference is actually more clear for the R2 frame:
http://screenshotcomparison.com/comparison/128074
Hope you don't mind, Laserdisc Master. I think these comparisons are very interesting, especially for members like yourself who despise jagged egdes. :-)
I agree completely! The MagicSR has shown it is possible to remove the aliasing, while still enhancing the detail significantly.
It would actually be very interesting to compare the detail enhancement by MagicSR V9 to Team Blu's upscale, since both upscales have successfully removed the aliasing, unlike SRV9.
The antialiasing is of course very impressive, as it always is with Laserdisc Master's upscales. However, there is also significant light and dark ringing around edges, especially noticeable on R2 and the troopers helmets, but also the stormtroopers arms in the 3rd screenshot. The edges are generally blurred. The loss of detail on Vader's arms, and the texture of the soldiers clothes is also quite significant in the 3rd comparison.
It would be interesting to see frame 17212, which contains a lot of small details.
Here's the result for SRV8 (from one of the previous posts), which is practically identical to SRV9 for this frame:
I think the colors are pretty spot on. I think the compression on the frame makes it looks like it needs more work, and the color correction reveals the compression artifacts, rather than create new artifacts.
ROTJ indeed is in very good shape. The color, contrast, and sharpness look amazing!
Thanks for the compliments! Glad to hear you enjoy the work and screenshot comparisons. I also often use mobile devices for the screenshot comparisons, because the zooming on mobile devices makes it easier to look at the details, than to put your face against your computer screen.
As with most techniques, there are many ways to implement the methodology. However, as a rough guide, a super resolution algorithm defines a reference frame, and subsequently estimates how objects, often defined as image patches, can be mapped onto the reference frame. The image patches are then averaged using some form of weighted averaging, where the weights are related to the similarity to the reference frame. The weighting reduces the chance of wrong detail placement, the socalled registration error. After the averaging the resulting frame is deblurred leading to the final result.
It seems to me that it's some kind of motion blurr or temporal denoising, unless it's the result of some kind of temporal compression, as not only is detail missing, but blurred detail has also been added. It's also not visible in other parts of the frame, which is odd. I guess Team Negative1 knows best, since they have access to the uncompressed source.
Here's a comparison for the soldier at the 3 min mark. The tiny aliasing (ceiling/floor) is reduced, the larger ones are still intact:
http://screenshotcomparison.com/comparison/127846
It's not that there's no improvement on R2, just that it's not very impressive :-P:
http://screenshotcomparison.com/comparison/127848
Edit:
Despite the fact that the current antialiasing doesn't solve the problem of aliasing, I'm still pleased with the result, because the goal of not sacrificing detail has been maintained, while still reducing the aliasing to a certain point. As for the haloing filter this antialiasing filter removes most of the undesired artifacts caused by the deblurring step, that's part of the super resolution methodology.
I could try, although other parts of R2 would become quite blurry. The settings I'm using now leave all of the detail intact.