Star Wars Edits - Deepfakes, Artificial Faces | Discussion

We’ve seen the first use of deepfakes on a official Star Wars project just this December with Luke skywalker in The Mandalorian season 2, with the last couple of years deepfakes have substantially taken a storm all over the internet. I’ve recently been experimenting with deepfakes / artificial face programs for last few months and with where everything has been going it could be a huge game changer for fan-films and fan edits, I’ve seen people suggest deepfakes accross all sorts of edits now and we’ve seen a few fan projects make use of it.

Star Wars SC 38 Reimagined
https://www.youtube.com/watch?v=to2SMng4u1k

Harrison Ford in Solo: A Star Wars Story [DeepFake]
https://www.youtube.com/watch?v=bC3uH4Xw4Xo

Deepfakes aren’t the best even by ILMs standards, Luke looked good but a little rough around the edges. Testing with deepfakes I think they could make really great holograms providing good dialogue provided by voice actors or recycled from games & TV shows, deleted scenes etc. I recently tried deepfaking Palpatine using Dialogue from Rebels / ROTJ footage.

Test Hologram: https://youtu.be/ipGWdYn9uAI

I know a lot of people here think CGI Sidious looks too rubbery in his fight scene with Mace in ROTS, those shots are so short I wonder how well a fake could plus it up.

act on instinct said:

I know a lot of people here think CGI Sidious looks too rubbery in his fight scene with Mace in ROTS, those shots are so short I wonder how well a fake could plus it up.

That’d be interesting, at the moment I’m considering making a hologram for the unused emperor message from TROS.

What about General Dodonna in Rogue One?

Good relations with Ms. Dodonna, Hal has.

I attempted bringing the Obi-Wan message from Star Wars: Rebels to live action using the same method from my Palpatine edit, didn’t turn out as good the mouth movement looks rough at points but with the dark lighting and hologram effect its really hard to tell so works in its favour.

Test: https://www.youtube.com/watch?v=CM2PeEo0gQc

Dude that Emperor hologram looks excellent! I could really really use your help on something for my ANH edit if you’re willing to.

G&G-Fan said:

Dude that Emperor hologram looks excellent! I could really really use your help on something for my ANH edit if you’re willing to.

Would require audio, depends what you’re thinking

Cinefy said:

Would require audio, depends what you’re thinking

Something like this first draft I made months ago

https://www.youtube.com/watch?v=Am4HiwXBCAc

It’s insane how much better that looks.

lavoyd said:

Is anyone planning on incorporating the new footage from Corridor Digital’s version of the Luke Mandalorian appearance? https://youtu.be/861gfPVmgdc?t=1044

Corridor’s wig is a little long but that can be adjusted with some feathering, the added emotion seen in Luke’s face is a huge step up. I feel like a hybrid version between Corridor and Shamook’s edit would be nearly perfect.

That’d be a very difficult task as they’re using a different actor entirely, its possbile the hair could be altered as they’re face is very high detailed / more life like than the show it could be worth while using.

lavoyd said:

Luke Shamook deepfake in 4K (No Audio) for editing purposes: https://drive.google.com/drive/folders/1s1kZA9sJxaFip9nUmQvGgBYU1qldz19x?usp=sharing

That turned out surprisingly well, wasn’t sure how deepfake would turn out / react with the upscaling.
I hope that ILM improves they’re deepfakes for future Luke appearences or other characters

lavoyd said:

Also, I have a huge list of fan edits (including this Mandalorian fix) that I will begin crafting/uploading as soon as my new computer arrives. I’ve got a Last Jedi edit that I haven’t been able to complete due to computer issues but it’s about halfway completed on my current computer. After that is finished, I’ll start work on my definitive edits for the rest of the series. Pumping out a Mando edit should be easy compared to these movies 😃

Look forward to seeing that Shamooks deepfake of Lukes in the full episode lavoyd.