Sign In

ZigZig's THE PHANTOM MENACE Theatrical reconstruction 1080p – V1.0 work in progress

Author
Time
 (Edited)

Update (2018-12-29)

Some news after many weeks …

Since ChewieLewis’ project (https://originaltrilogy.com/topic/Phantom-Menace-99-HD-Theatrical-Version-by-Chewielewis/id/60924) started on the same basis as mine, and since ChewieLewis told me that he wanted to deliver his project as soon as possible in 2018 (and thus, it wouldn’t be possible to collaborate because my work speed was much more slow than his), it seemed constructive to me, for the benefit of all, to restart/reload my own project on a new different base, even closer to the “Despecialized” approach: rebuilding TPM in HD by taking Blu-Ray as the main source (instead of merging HDTV and STDV sources).

As a result, the OT community will benefit from two different approaches:

  • a reconstruction from HTDV and SDTV sources (ChewieLewis’ project)
  • a despecialization from Blu-Ray (my project).

The process is obviously more complicated, but is well advanced:

  • rebuilding every altered scene (mainly via rotoscoping + the modeling technique I developed for the previous project) - almost done
  • color grading and cropping on a scene by scene basis - to be done

I have also been able to find other major sources (ie captures from the first DLP version of Texas Instruments in 1999, or negative scans with original cinematographic subtitles).

I’ll try to deliver the final result for the 20th anniversary of TPM (19th May 2019)

NB: I sincerely regret that ChewieLewis insisted so much on finishing the project in 2018 - which was the main reason for our lack of collaboration (since I was not able to work so fast)… finally, his project was not delivered as fast as he said in 2018, so we could have collaborate.
That’s life… 😃

Some comparaisons :
http://www.framecompare.com/image-compare/screenshotcomparison/029MNNNU
http://www.framecompare.com/image-compare/screenshotcomparison/WP7PNNNX
http://www.framecompare.com/image-compare/screenshotcomparison/029CNNNU

Original post

As some of you maybe know, I’m working on a reconstruction of The Phantom Menace in full HD for more than one year. The goal of this project is to provide a 100% theatrical version of the movie, in 100% HD (not a single frame in upscaled SD, everything in real 1080p), as it was never released, except maybe a German HD broadcast that was never succesfully recorded.

Why do I talk about it now

Two reasons :

  • I didn’t want to create a thread about it until my project was advanced enough. Well, I feel that it is now advanced enough ! I think it’s time to talk about it and share on this forum some sources, some personal techniques to recover missing scenes in HD, the results that I can get, and to discuss about it.

  • Other similar projects are on the way (certainly Poita’s 35 mm scan and ChewieLewis HD reconstruction, and maybe other ongoing projects), so it seems to be a good time to talk about mine. While other projects are pursuing the same goal (providing a theatrical version of The Phantom Menace), they take different paths. I hope that when each project will be released, it will be possible to merge the various skills of everyone to achieve an ultimate version.

Challenges in HD reconstruction

There are two main challenges in recovering the theatrical version :

  • The original theatrical colors are not available in HD: the HDTV version has too much red everywhere and contains some scene differently regraded than others ; the Blu-Ray was re-regraded on a scene by scene basis and has no more original color at all.
  • Some scenes seem to be definitely lost in HD and only available in (poor) SD : arrival on Coruscant – with a view on Palpatine’s office (replaced by a taxi sequence), Palace of Naboo by night without an added CGI-bridge, and Senate scene with a cameo of Trish Biggar and Iain McCaig as Senators. Other scenes were reassembled differently in HD, or were available only on some bonuses, but they are not definitely lost. The scene of Qui-Gon on Tatooine by night was directly taken from Digital Video for HDTV and BR versions, contrary to the original 35mm version, so the colors are pretty different.

Solutions that I used

  1. The original colors can be deduced from some versions, since LaserDisc, ORF1 broadcast, Euro Canal Plus broadcast and some bonuses on Blu-Ray or Digital Collection show the same range of colors (once they are well calibrated), that perfectly fit old photos taken from 35mm in early 2000. For the rest, the amazing DrDre’s Color Matching tool, and a lot of time, allowed me to do a scene by scene color regrading.

  2. Missing scenes were painstakingly recreated in several steps :

  • Widely enhancing video quality by using ^…^'s PaNup technique (as described here) and merging together ORF1 broadcast, Euro Canal Plus broadcast, LaserDisc and VCD.
  • Then, a very complicated technique of my own (whom I’m very proud of) that gives full HD frames.

Other actions

  • Everything was edited in 24p (not 23,976p), as it was shown in theaters almost 20 years ago.
  • Every shot was upscaled in 4K using Super Resolution fo better HD-reconstruction, then downscaled to 1080p.
  • Theatrical DTS sound was fully restored from theatrical DTS CD-ROM, without any other audio treatment than applying the APT-X100 post production recommendations (as found here).
  • Theatrical Dolby EX 6.1 was fully restored from Laserdisc.

Current status

2018-06-12 :

  • Reassembling HDTV sources to theatrical cut : 100 %
  • Rebuilding missing scenes (PaNup) : 100 %
  • Rebuilding missing scenes (1080p) : 50 %
  • Regrading colors : 70 %
  • Syncing Audio (DTS, Dolby EX, PCM 2.0) : 00 %
  • Misc (bonuses) : 00%

Results

Update 2018-06-26
Here is a comparison between a “simple” upscale from SD and my final HD reconstruction for the Senate scene :

Here is a comparison between original LaserDisc, Euro Canal Plus PAL broadcast (SD), ORF1 PAL brodcast (SD) and my final HD reconstruction for the arrival on Coruscant (presumed unavailable in HD). It is the 80th frame of the scene :

http://www.framecompare.com/image-compare/screenshotcomparison/K7W7NNNX

Same frame compared in detail :

Frame comparison

Is there a contention with other projects ?

Well no. We waited so long to have a theatrical version of The Phantom Menace in HD, that we will not sulk our pleasure now that several projects are moving forward!
There is definitely no contention with Poita, since the two projects are totally complementary, and I rely heavily on his work to further improve the missing scenes in HD (and I financialy support it).

Regarding ChewieLewis, we started this project approximately in the same time (even though I’ve already talked about mine a long time ago). It seems that we work with the same sources and we will probably achieve similar results, even I’m pretty confident that the scenes fully rebuilt in HD will probably be sharper and more detailed in my version, due to the technique I developed. But as far as I am concerned, there is no contention, but rather a kind of « competitive sportsmanship » which is probably pushing us to go beyond our limits, and it’s a good thing.
I am pretty sure that some scenes will be more satisfactory in his version, and others in mine, and I really hope that we eventually can make later an even better common version.

When will it be released

As I have a little girl that requires a lot of time, plus a full time job, it will take me several more weeks to release something.
The scenario is to release my version before the 20th anniversary (19th May 2019), and I hope even in 2018.

Sources

[This part has yet to be written]

Special thanks

  • Harmy for the inspiration
  • Nightstalkerpoet for his German HDTV source that he shared almost a year ago
  • DrDre for his amazing Color Matching tool
  • Althor1138 for his precious Laserdisc preservation that made me want to discover the amazing world of Laserdiscs a year ago
  • ^…^ for his PaNup technique and all the FanRes community
  • Schorman for his HDTV 1080p preservation
  • ChewieLewis for the challenge 😃
Author
Time

Will your final output be 24.000fps or 23.976fps?

And will you be restoring theatrical subtitles baked into the video like Despecialized, or will you keep the HDTV subs or use soft/hardware subs?

a trolling bantha

Author
Time
 (Edited)

Hi ChainsawAsh,

24.000fps vs 23.976fps

This question does not really arise in Europe, since both formats are fully supported.
Anyway, my idea is to release both versions :

  • 24.000fps to perfectly fit theatrical audio and video (AFAIK, European and US Blu-Ray players fully support both 23.976fps and 24fps)
  • 23.976fps downrated from 24.000 fps final file (with audio downsampled) to avoid compatibility issues on the American continent

Burned-in subs vs. HDTV subs vs. soft/hardware subs

AFAIK, hard subs were only visible in the original English version. Dubbed versions didn’t contain English hard subtitles (but German, Italian or French subtitles instead).
So my idea is to release a file without burned-in subtitles (to allow future international versions), then to add picture-based subtitles (that match the theatrical English version) when muxing mkv or Blu-Ray files.

What do you think ? Is it a good idea ?
Since the work is not finished yet, do not hesitate to propose something else!

Author
Time

I’m partial to burned in subs, but that’s mainly because my media player doesn’t recognize default or forced sub flags and I hate having to manually turn them on every time. Plus it would match my Despecialized SW and ROTJ, my HDTV AOTC preservation, and the official TFA and RO releases. But that’s my personal preference - if you’d rather do graphical PGS subs that are a close match to the theatrical, that’s your choice. I also don’t think you’d be able to do the dissolves that way as they exist in the theatrical version, but I could be mistaken.

But this is also coming from a US citizen, so I understand the desire for more universal compatibility with multiple languages. I guess I’m just partial to the idea of preserving the English theatrical version exactly as it was.

a trolling bantha

Author
Time

A big thank you for these reflections, your arguments are relevant and definitely admissible!
I’m going to think about making a “worldwide” version in 24.000fps without burned-in subtitles, and a “US” version in 23.976p with burned-in subtitles: it is perhaps the best compromise…

Author
Time

That sounds like a good compromise indeed.

a trolling bantha

Author
Time

Really looking forward to this ZigZig.

All my life as I looked away to the future, to the horizon. Never in my mind did I know where I was, what I was doing.

Author
Time
 (Edited)

Thanks to Trillary Dump, a new HD image of the original Senate scene miraculously resurfaced (see original post here).

Precisely, my HD reconstruction tool feeds on this kind of HD images: the more it receives, the better the final result is.
So I added this new image to my tool and regenerated the scene.

Here is the resut (compared to another project where a simple upscaled SD video seems to be used):

http://www.framecompare.com/image-compare/screenshotcomparison/KKW7NNNX

Comparison :

SD upscaled :

ZigZig’s HD reconstruction :

I did it quicky without really adjusting the fine parameters, but the result seems to me already very promising.

I’m currently writing a tutorial about this technique, with a video sample from another missing scene (arrival on Coruscant) which gives an astonishing result identical in quality to the HDTV version.
But it takes lot of time (especially since English is not my mother tongue, and I have a little girl who asks a lot of attention everytime I try to sit at my computer).

Author
Time

Looks great!!

I can answer almost all questions anyone might have about the Sith from Star Wars Legends, and please do PM me for the bd25 DEED(Despecalised Editions), as I have this version, though I can’t answer technical questions about them. Auntie Derry/Rumpelstiltskin.
Do not go gentle into that good night, Though wise men at their end know dark is right, They
Do not go gentle into that good night. “Stay Phrosty” - Lemar Kentell, my other half. Feel the love.

Author
Time
 (Edited)

Hi,

At the request of a member of this forum, I uploaded the “simple” overlaying of two SDTV rips (aka spOrv’s “PaNup”) on MySpleen.

It is NOT the HD reconstruction I’m currently working on, but a good SD version that I made to use as guide for my current project.

PS: I don’t know if it is better to make a new thread about it, or just to mention it in this thread… Dear moderators, don’t hesitate to move this post to a new thread if it’s better.

Anyway, here is the nfo :

nfo said:

Here is the theatrical cut of The Phantom Menace preserved from two TV rips, without any other reconstruction than cleaning and overlaying both sources

Sources :

  • ORF Ein PAL broadcast
  • Euro Canal Plus PAL broadcast

What is done :

  • changing framerate to 23,976 fps
  • upscaling both sources (using SuperResolution from VideoEnhancer)
  • slightly cleaning both sources (very slight Photoshop filters as smart sharpen and shake reduction)
  • adapting light/contrast from Euro Canal Plus to match ORF Ein
  • painstakingly overlaying both sources by matching them to the nearest pixel
  • adjusting the length/width ratio to perfectly match the DVD ratio (based on Schorman’s 1080p preservation)
  • removing German subtitles (by using masks)
  • filling empty frames (by using the source that had the missing frame)
  • mixing with Laserdisc stereo track
  • Editing alien subtitles srt file (revised and synced to theatrical version)

Nothing more was done (no reconstruction, datamoshing, recomposing, modeling…). The average quality is close to a DVD, with two advantages :

  • colors are close to theatrical ones (no red tint like on the DVD)
  • it is the original theatrical cut (no Naboo bridge, no taxi sequence, no extended podrace…)

This file was originally intended to private use only as a guide for the project of HD reconstruction I’m still working on, but someone from OT.com asked me to share it.

So Trillary Dump, this is for you!

Video : MPEG4 (h264 main L3.2, yuv420p) 1280x720 23.976fps 3065kbps
Audio : AAC 44100Hz stereo 320 kbps

*** Feel free to share it or use it in a fanedit, but please always mention this .nfo and/or the link to this page ***

Author
Time

How does one over multiple video sources anyways?

The Bunny, The Bunny, woah, I love The Bunny

Possessed said:
Danfun, do you also love the soup and the bread, or just the bunny?

SilverWook said:
Use of the bunny outside off topic is getting out of hand.
When outside off topic, use a link to the bunny if you really feel the need to invoke it.
Warnings will be next if some restraint is not shown.

Author
Time

Just throwing this out there as a suggestion - a lot of us want to see theatrical Ep 1 in HD, but I think a lot of us also want to see Theatrical Ep 1 WITH CGI Yoda. TPM creates this conundrum of the theatrical version being less canonical with Eps 2 and 3 due to the use of Creepy Puppet Yoda. Maybe two versions would serve well to address this second, less vocally sought after version? I have a lot of faith in your process and the eventual quality of your release.

Some people call them Force Ghosts. I call them Midichlorian Swarms.

Author
Time

Hi NSP,

Thank you for your message. I’m not sure that I understand the purpose of your suggestion. What would be the interest of a theatrical Ep1 with CGI Yoda, vs. the official Blu-Ray release (that stars already a CGI Yoda)? Do you mean that you want to see the original cut (with a shorter podrace, no air taxi sequence and so on), but with CGI Yoda instead of CPY?

Author
Time

ZigZig said:

Hi NSP,

Thank you for your message. I’m not sure that I understand the purpose of your suggestion. What would be the interest of a theatrical Ep1 with CGI Yoda, vs. the official Blu-Ray release (that stars already a CGI Yoda)? Do you mean that you want to see the original cut (with a shorter podrace, no air taxi sequence and so on), but with CGI Yoda instead of CPY?

I believe that’s what he means. It’s something I’d be interested in myself as well, but would certainly not fit as a “preservation” in any sense, so it’s kind of irrelevant for this project.

a trolling bantha

Author
Time
 (Edited)

Yes - while I prefer theatrical TPM, Yoda not being consistent in the prequels makes my viewing preference a toss up. I understand that this is a preservation, so you may not feel it’s within your desired goals to release such a version. My suggestion is intended more to provide you the opportunity to simultaneously create such a project while you’re already in the thick of things, as opposed to someone else using your project later on as a source to release such a hybrid version.

Some people call them Force Ghosts. I call them Midichlorian Swarms.

Author
Time

OK, I get it.
I could indeed release a fanedit (with CGI Yoda into theatrical cut) at the same time as I’m working on my preservation.

Or (why not) replace CGI Yoda by CPY into Ep II and Ep III (that would be a real technical challenge) 😃

Author
Time

I think it would be better to create a “theatrical CGI Yoda” cut using Blu-Ray footage for everything except what’s necessary to revert the original editing here and there, otherwise you’ll have a big gap in visual appearance between the CGI Yoda shots and everything else. It probably wouldn’t be that hard of a project to tackle, though I imagine you’d want to start with a color corrected and regrained version of the BR just because, well, why wouldn’t you?

a trolling bantha

Author
Time

Well, that is definitely a good idea for a new fanedit… that I’ll consider after my current preservation project!

Author
Time

Since this project will be 100% theatrical, any theatrical audio track would be in good sync. The original theatrical DTS audio track will be already included.

But this project is not released yet…