Sign In

Deepfake Tarkin & Leia swap (Rogue One) (up on the Shamook youtube channel)

Author
Time
 (Edited)

So there is a guy on youtube called “Shamook” who did an incredible job deepfake fixing Tarkin and Leia… is it just me or does anyone else want these scenes swapped in their version of Rogue One?
 

check it out here:

https://www.youtube.com/watch?v=_CXMb_MO3aw - a 2 minute video on the Shamook youtube channel
 

Does anyone know this “Shamook” person? I tried to reach out via email but didnt get a response…

he is also working on a Luke deepfake for Mando season 2 finale

Author
Time

Unfortunately Shamook’s videos aren’t at a perfect 23.976 fps, so they have a few duplicated/missed frames. You could fix this manually, and use EBSynth to generate the missing frames, but it’s a little bit of a pain.

Author
Time

sade1212 said:

Unfortunately Shamook’s videos aren’t at a perfect 23.976 fps, so they have a few duplicated/missed frames. You could fix this manually, and use EBSynth to generate the missing frames, but it’s a little bit of a pain.

so upon importing into a DVW it wouldnt line up or would look funny?.. forgive my ignorance i’m an audio guy and pretty limited with my video knowledge… I just know it looks so real compared to the original and ties into ANH so much better.

Author
Time

I wonder if he would be able to send “you/us” those video clips in the proper fps to avoid that hassle. When I watch the two in comparison, I think the deep fake is “better” … mainly the eyes stand out the most to me being more real.

“Because you are a PalpaWalker?”

Author
Time

jarbear said:

I wonder if he would be able to send “you/us” those video clips in the proper fps to avoid that hassle. When I watch the two in comparison, I think the deep fake is “better” … mainly the eyes stand out the most to me being more real.

I agree. And yes would be great if he did have the proper format which he could may well have. I will try and hit him up again.

Author
Time

It definitely looks a bit better but I feel like the effect was already pretty damn good in Rogue One.

Author
Time

leftshoe18 said:

It definitely looks a bit better but I feel like the effect was already pretty damn good in Rogue One.

Arent we all on the quest for the perfect edits? even if its just a “little bit” better? hehe

Author
Time

danieldubb said:

leftshoe18 said:

It definitely looks a bit better but I feel like the effect was already pretty damn good in Rogue One.

Arent we all on the quest for the perfect edits? even if its just a “little bit” better? hehe

Exactly.

“Because you are a PalpaWalker?”

Author
Time
 (Edited)

Hi, I’ve spent the past couple of weeks trying to implement the deepfakes into the original film on my spare time, Shamook’s work actually fits pretty great! I encountered no issue with the framerate, the bigger issue however is that the video doesn’t include every shot from Tarkin in the movie. I’ve used other deepfakes for the missing shots but the quality is not as good as Shamook’s.

Here’s a preview of all the work I’ve done so far:
https://vimeo.com/494872761

For the first Tarkin scene I used a couple of shot’s from derpfakes video here:
https://www.youtube.com/watch?v=6Zn1vt9vdwU
For the scene on Jedah I used one shot from Jarkan’s video here:
https://www.youtube.com/watch?v=gg1LPc6WUdM
and three shots from birbfakes video here:
https://www.youtube.com/watch?v=BcEtPLsJ-F0

For the second Tarkin shot I used a lot of trickery (spent two days on it) to overlay a frame from the third shot made by Shamook, so that both shots matched. I also altered the colors on the Jarkan and birbfakes footage to match the surrounding Shamook shots, and made Tarkin’s eyes more blue to match Shamook’s aswell.

Personally I think it looks way better. The CGI has aged very poorly, even back in 2016 many found it bad. The deepfakes are way more lively and they actually look and feel like Peter Cushing/Carrie Fisher.

It’s a bummer that there’s been no response from Shamook so far, it would be great if we could get those missing shots from him so that the quality could be completely consistent. But I do believe what’s available is enough, and far better than the original CGI.

Author
Time

danieldubb said:

leftshoe18 said:

It definitely looks a bit better but I feel like the effect was already pretty damn good in Rogue One.

Arent we all on the quest for the perfect edits? even if its just a “little bit” better? hehe

Oh for sure.

Author
Time

Looking good, Burbin!

Well done. I will disengage self-destruct initiative.

Author
Time

Hal 9000 said:

Looking good, Burbin!

Cutting the Deepfakes into ur edit of RO was my main goal lol.

@Burbin looking forward to checking these out! Glad someone else wants these in their cut.

Author
Time

The deepfake face looks more realistic however the animation of the original CG face is so stiff and unrealistic that the Luke scene unfortunately isn’t much of an improvement.

Shamook’s Tarkin and Leia are great though. I’m glad this thread was started, I was going to try contacting him. It’s a shame he hasn’t gotten back to anyone yet.

Author
Time

TheBoogeyman1023 said:

The deepfake face looks more realistic however the animation of the original CG face is so stiff and unrealistic that the Luke scene unfortunately isn’t much of an improvement.

Shamook’s Tarkin and Leia are great though. I’m glad this thread was started, I was going to try contacting him. It’s a shame he hasn’t gotten back to anyone yet.

yes it is… i feel like shamook belongs in this community… his work is fantastic… if you want to try and reach out I say go for it… how many of us can he ignore? we must rally together lol…

Author
Time

danieldubb said:

TheBoogeyman1023 said:

The deepfake face looks more realistic however the animation of the original CG face is so stiff and unrealistic that the Luke scene unfortunately isn’t much of an improvement.

Shamook’s Tarkin and Leia are great though. I’m glad this thread was started, I was going to try contacting him. It’s a shame he hasn’t gotten back to anyone yet.

yes it is… i feel like shamook belongs in this community… his work is fantastic… if you want to try and reach out I say go for it… how many of us can he ignore? we must rally together lol…

I’ll try direct messaging him on YouTube.

Author
Time

TheBoogeyman1023 said:

danieldubb said:

TheBoogeyman1023 said:

The deepfake face looks more realistic however the animation of the original CG face is so stiff and unrealistic that the Luke scene unfortunately isn’t much of an improvement.

Shamook’s Tarkin and Leia are great though. I’m glad this thread was started, I was going to try contacting him. It’s a shame he hasn’t gotten back to anyone yet.

yes it is… i feel like shamook belongs in this community… his work is fantastic… if you want to try and reach out I say go for it… how many of us can he ignore? we must rally together lol…

I’ll try direct messaging him on YouTube.

that might work, i only tried gmail!

Author
Time
 (Edited)

Shamook has done the best Tarkin.
https://www.youtube.com/watch?v=_CXMb_MO3aw&t=1s&ab_channel=Shamook
Derpfakes has done the best Leia (make sure you check this, his 3rd version).
https://www.youtube.com/watch?v=1chnCgya32o&ab_channel=derpfakes
Very Carrie-like facial performance!

As for Luke, I fully expect a revision that works on the animation. What we have now was done quickly right after the episode premiered. It’ll get further tweaks. This is par the course.
The face already looks much better and…

danieldubb said:

leftshoe18 said:

It definitely looks a bit better but I feel like the effect was already pretty damn good in Rogue One.

Arent we all on the quest for the perfect edits? even if its just a “little bit” better? hehe

For sure!

Ray’s Lounge
Biggs in ANH edit idea
ROTJ opening edit idea

Author
Time

DigMod said:

I’d agree that derpfakes’ Leia is the best looking. I used it here in this shot that I’ll be updating Rise of the Rebellion with. https://www.youtube.com/watch?v=VXXnFZIJFFo&feature=youtu.be&ab_channel=DigModiFicaTionFanedits
I’ll also be using Shamook’s Tarkin.

yes @rey_afraid just pointed this out as well! i agree… with shamook leia there is a flicker in her face from the side profile before the deepfake catches… but thanks all u guys for chiming in on this!

Author
Time
 (Edited)

I’ve finished all the Tarkin shots using the sources I listed before. Here’s a compilation of all the clips:

https://vimeo.com/496680995

derpfakes’ work is good but unfortunately the framerate on his deepfakes is off and it skips every other frame, so I used a combination of Jarkan and derpfakes for a shot on the first Tarkin scene. I originally tried using derpfakes’ Leia shot but like I mentioned it skipped frames, so I used Shamook’s and added a subtle fade to remove that flicker on the face (I actually did a bunch of small edits and fades on a few Tarkin shots too).

EDIT: I should also mention I gave the mask on Shamook’s deepfakes a slight bit of opacity, which let some color bleed through and helped with blending them with the other sources.

Shamook’s footage is of much higher quality but I matched the rest as best as I could. The only shot I didn’t find a deepfake for is when Tarkin arives on Scarif and says “Lord Vader will handle the fleet…”, but I still masked over his face on that clip and edited it slightly to match the rest of the footage (slightly smoothed, changed the color a bit). It’s a medium shot so it doesn’t look that bad.

If anyone wants the link of the full quality clips they can PM me, I’ve sent them to a few people who’ve asked.

Author
Time

Nice work there! I’m working on the Shamook footage in my Rise of the Rebellion Survivor Cut and noticed those missing scenes. I don’t know what NLE you use, but if you are using Vegas Pro you can adjust the rate to match the 23.97sfps base. It’s not perfect, but I was able to get the derpfakes Leia scene to work that way.

digmodification.wordpress.com

Author
Time

does anyone have an edit of the full movie with the deep fakes added?

Author
Time

ThisIsCreation said:

does anyone have an edit of the full movie with the deep fakes added?

We are all workin on it lol. Maybe I’m a week or two.