logo Sign In

Star Wars GOUT in HD using super resolution algorithm (* unfinished project *) — Page 27

Author
Time
 (Edited)

O yes, the Hyperspace Collection, of course. Forgot about that one, sorry... I've got to check it out. 

Author
Time

DrDre said:

O yes, the Hyperspace Collection, of course. Forgot about that one, sorry... I've got to check it out. 

 Good luck, it seems to be quite seedless.

Author
Time

I wonder, given that you tweak settings shot by shot now, if some of r2's closeups shouldn't have their own settings. From the scenes we've seen, he's the only aspect that is actually distracting.

Author
Time

I could try, although other parts of R2 would become quite blurry. The settings I'm using now leave all of the detail intact.

Author
Time

Makes sense. Just wondering if the compromise between detail and anti aliasing should fall more towards the latter for a few select moments. It really is nice being able to see the extra detail on R2's dome, but the effect is diminished when the curves have strong aliasing.

What we need  is mixing or rotoscoping the surfaces from one version with the edges of another. :P

 

Author
Time

towne32 said:

What we need  is mixing or rotoscoping the surfaces from one version with the edges of another. :P

That's not too hard if you have an edge mask that only picks up "big" edges. It wouldn't take long to configure TCannyMod in this way.

A picture is worth a thousand words. Post 102 is worth more.

I’m late to the party, but I think this is the best song. Enjoy!

—Teams Jetrell Fo 1, Jetrell Fo 2, and Jetrell Fo 3

Author
Time
 (Edited)

DrDre said:

Slim Shady, you a basehead.

 Do you think we could get a v8/v9 comparison of a frame at the 3 minute mark (soldier pointing gun at door). Would like to see the aliasing improvement, if any, in v9.

Author
Time

joefavs said:

DrDre said:

O yes, the Hyperspace Collection, of course. Forgot about that one, sorry... I've got to check it out. 

 Good luck, it seems to be quite seedless.

 I don't recall for sure but it might be on tehparadox.  I got the Hyperspace bonus discs from somewhere a while back, and I don't torrent.

Author
Time
 (Edited)

joefavs said:

DrDre said:

O yes, the Hyperspace Collection, of course. Forgot about that one, sorry... I've got to check it out. 

 Good luck, it seems to be quite seedless.

Considering how long it's already been up I'm surprised to see folks expecting it to be rocking with seeders.  This is normal thing, it's not like someone is purposely keeping you from having it, most people who snagged it and seeded a great deal have moved on to other things.

:)

Author
Time

Jetrell Fo said:

joefavs said:

DrDre said:

O yes, the Hyperspace Collection, of course. Forgot about that one, sorry... I've got to check it out. 

 Good luck, it seems to be quite seedless.

Considering how long it's already been up I'm surprised to see folks expecting it to be rocking with seeders.  This is normal thing, it's not like someone is purposely keeping you from having it, most people who snagged it and seeded a great deal have moved on to other things.

:)

 I actually managed to get disc one completely off of a fellow leach, but it dried up right after that. I'll see if tehparadox still has the rest. I don't mean to sound like I'm blaming anyone for not seeding this ancient torrent, I've just only become aware of a lot of this stuff in the past couple of months and I'm a little bummed to have missed the boat.

Author
Time
 (Edited)

Here's a comparison for the soldier at the 3 min mark. The tiny aliasing (ceiling/floor) is reduced, the larger ones are still intact:

http://screenshotcomparison.com/comparison/127846

It's not that there's no improvement on R2, just that it's not very impressive :-P:

http://screenshotcomparison.com/comparison/127848

Edit:

Despite the fact that the current antialiasing doesn't solve the problem of aliasing, I'm still pleased with the result, because the goal of not sacrificing detail has been maintained, while still reducing the aliasing to a certain point. As for the haloing filter this antialiasing filter removes most of the undesired artifacts caused by the deblurring step, that's part of the super resolution methodology.  

Author
Time

I continue to be amazed by these ever-more-impressive iterations. I am primarily monitoring this thread via my mobile device with retina-grade OLED screen. I especially enjoy the Screenshot Comparisons, because I can dynamically zoom in or out of the paired images and easily spot the differences when toggling between the screenshots. I do wonder about how my mobile browser handles these zooms, without "upscaling", but to my eye the image is simply being enlarged when I zoom in, preserving the screenshots as they were uploaded.

As a visually-oriented guy with no experience developing imaging software, I'd like to ask a couple of questions about what is going on "under the hood" when using a SuperResolution operation. I haven't (yet) read the SR scientific paper referenced in this thread, since I expect that it is likely to be full of equations that would be above my head.

Conceptually, though, I believe I understand how it works with motion picture images: for any given still frame in a sequence, the surrounding frames are used to recruit additional picture detail... Sort of like High Dynamic Range (HDR), but for image detail, rather than exposure detail. (I remember there was discussion that only frames following the given still frame could be used to recruit details for some reason).

So, if this is a somewhat automated process, is the software able to accurately track the motion of an "object" (such as an actor, prop, spaceship, or set) as it moves throughout a scene? I can imagine that a relatively stationary shot would be  rather simple for the automated process to work. Or, perhaps a simple camera move would also yield good results rather easily.  But is the software also sophisticated enough to recruit detail from a filmed object as it moves in 3D space in front of the camera lens, without incorrectly placing detail that does not belong? For example, if RD-D2's dome were to rotate significantly through the course of a shot that is to be processed with a SR script, how does the script not wrongly place detail of R2's eye-lens for those frames that the eye is facing away from the camera? Also, light and shadow and the sheen of metal and glossy surfaces can make pixel values change radically during the course of a shot, even for objects that only move a small amount in the frame.

If the SR process were a manual one, essentially a visual effects technique, I suspect a digital artist could take these filmmaking aspects into account and really work amazing wonders with custom-tailored upscales for each shot. However, this would obviously mean a great deal of manual work.

If your crop is water, what, exactly, would you dust your crops with?

Author
Time
 (Edited)

Thanks for the compliments! Glad to hear you enjoy the work and screenshot comparisons. I also often use mobile devices for the screenshot comparisons, because the zooming on mobile devices makes it easier to look at the details, than to put your face against your computer screen.

As with most techniques, there are many ways to implement the methodology. However, as a rough guide, a super resolution algorithm defines a reference frame, and subsequently estimates how objects, often defined as image patches, can be mapped onto the reference frame. The image patches are then averaged using some form of weighted averaging, where the weights are related to the similarity to the reference frame. The weighting reduces the chance of wrong detail placement, the socalled registration error. After the averaging the resulting frame is deblurred leading to the final result. 

Author
Time

Great job on the anti-aliasing so far!  Every little bit helps.  It seems as though there are single pixel high aliasing problems which you have now addressed and thicker multiple pixel high aliasing problems (R2 Closeup).  Maybe both could be addressed using two passes and the TCannyMod blending/masking stuff mentioned by AntcuFaalb above.  Otherwise, I still would suggest having two versions and pick scene by scene which is better with regards to how bad the aliasing is.  More detail is great unless the aliasing becomes distracting in which case less aliasing would be better than more detail.

Author
Time
 (Edited)

That looks great! I think the main problem, though, is that there's a bit more noise (noticeable in the second and third shots there).

Author
Time
 (Edited)

The antialiasing is of course very impressive, as it always is with Laserdisc Master's upscales. However, there is also significant light and dark ringing around edges, especially noticeable on R2 and the troopers helmets, but also the stormtroopers arms in the 3rd screenshot. The edges are generally blurred. The loss of detail on Vader's arms, and the texture of the soldiers clothes is also quite significant in the 3rd comparison.

It would be interesting to see frame 17212, which contains a lot of small details.

Here's the result for SRV8 (from one of the previous posts), which is practically identical to SRV9 for this frame:

http://screenshotcomparison.com/comparison/127401

Author
Time

I think it is quite beneficial to have both upscales so people can choose. From the evidence, its very clear that it will be impossible to achieve perfect detail, and remove all the aliasing.

In the end, I think the ultimate goal of proving Super Resolution as a viable upscale method for the GOUT has proven to be very successful. Plus, LaserDisc Masters MagicSR has provided impressive results too!

Author
Time
 (Edited)

I agree completely! The MagicSR has shown it is possible to remove the aliasing, while still enhancing the detail significantly.

It would actually be very interesting to compare the detail enhancement by MagicSR V9 to Team Blu's upscale, since both upscales have successfully removed the aliasing, unlike SRV9.

Author
Time

Both versions win, but only one wins in each screenshot.  I would choose DrDre's most of the time, but in bad scenes with huge aliasing issues that jump out (like the R2 and 3PO closeups), choose MagicSR.  This is easy enough to do in a script.  Yes, there will be elements that are better within each frame from either side, but when it is in motion, they are less noticeable unless they stick around for a long time which the aliasing tends to do for the entire scene.  As long as the aliasing is minor, then filling the scene with more detail is better.

Author
Time
 (Edited)

Here's a comparison for Team Blu vs MagicSR V9:

http://screenshotcomparison.com/comparison/128071

I think a close inspection reveals MagicSR retains more detail, while still effectively removing aliasing. 

Edit:

I think the difference is actually more clear for the R2 frame:

http://screenshotcomparison.com/comparison/128074

Hope you don't mind, Laserdisc Master. I think these comparisons are very interesting, especially for members like yourself who despise jagged egdes. :-)

Author
Time

To me it looks like the detail is very similar but the color correction of the Team Blu is making it harder to see some of the visible detail in the brighter areas.  The antialiasing is better in R2's shoulder with Team Blu.