Deepfake Tarkin & Leia swap (Rogue One) (up on the Shamook youtube channel) — Page 3

Shamook said:

Burbin said:

I’d be quite glad to have my work be rendered useless if Shamook could provide source quality files of the Leia/Tarkin deepfakes, as well as the missing Tarkin shots where I used other sources that are of notably lower quality.

https://www.dropbox.com/sh/n0m06uo7or6lfsb/AAC4xdD26_gbj_LTFJ5MjqVLa?dl=0
There are 24 clips of Tarkin and 1 of Leia in that dropbox folder.
They should be original film resolution and quality.

Can you let me know which Tarkin shots that you used other sources on, my file management is terrible and I may have them somewhere.

Hello Shamook! Wow! Thank you! I’ll need to go update my edit now 😃 So glad I popped in to see how OT is doing today 😃

WOW I ACTUALLY CLAPPED AT MY SCREEN WHEN I SAW YOU ON THIS THREAD SHAMOOK! Welcome! as its been said before you have some fans here, myself included! There is incredible work to be done with your skill!

I am most excited to get a full release of (at least) the Luke deepfake in Mando! But hopefully maybe even a tweaked deepfake to allow some of the age (stubble around his mouth) and mouth movement back to the shots. There are some seriously talented VFX artists floating around this forum. Regardless I will still take your OG deepfake in the final Mando episode over the original (no hate just, more palatable to wider audiences).

WELCOME AGAIN! Great to have you here.

-Axios

Wow … Thanks Shamook!

Also view your preview Burbin, wow, lot more detail with this new source … must reimplement now! hahaha!

Hey there Shamook, I notice there is a glitch with the Tarkin moments. He goes from his 3d face/head to his newly Deepfake ones suddenly. If you take a look at the first Tarkin file, you’ll see the jump for example.

Burbin said:

That’s just the way the deepfakes work, if the face is obscured or at an odd angle then it won’t be detected. The system won’t have enough data to construct a deepfake to put on top of it. In the clips I put together I used fade-ins to hide the shift into the deepfake.

Ah gotcha, after I sent that I assumed that was the case. So what I did with those scenes, is used bits of your scenes which you masked the crud out of it and crossfaded that during head movements/Tarket from unfocused camera spots to hide it. It actually worked pretty decently to incorporate it all.

Shamook said:

Hey all, Shamook here.
I was just googling myself and came across this thread. It’s really nice and refreshing to see so many people enjoying my videos. Sorry if I never responded to your emails or messages, I just don’t have the time to get back to everyone unfortunately. I think I got 300+ emails about the Mando deepfake.
Let me know if there are any specific things I might be able to provide you guys with; extra scenes, different video formats etc
Also I can verify I’m definitely Shamook if that’s necessary.
Cheers.

Shamook, I have a question about how your deepfakes work. In your videos, you seamlessly replace one actor’s face with another’s, keeping the original facial performance intact. Would it be possible to replace the facial performance?

For example, let’s say I want to completely replace an actor’s performance and dialogue with new footage I’ve filmed of my own actor. Is that possible with current technology? Either retaining the original actor’s face, or simply replacing it entirely with my new actor’s facial footage?

EDIT: I mocked up a video to try and explain my question better.

Let’s pretend I want to cast myself as Kylo Ren instead of Adam Driver, and change all of Kylo’s lines. Is it possible to take the footage I’ve filmed, and deepfake it onto Adam, resulting in:
a) my face and new performance completely replace Adam’s, or
b) it looks like Adam’s face is giving my new performance.

Like this, except with your amazing facial replacement skills, instead of my drag-and-drop example.

(I don’t want to actually do that, I just needed an example with some footage I already had on the computer.)

Shamook said:

There are primitive ways to alter mouth movements but the quality is subpar for me to consider using it at the moment.
You could film yourself acting the role, rotoscope yourself onto the original actor, then apply a deep fake on top of all that.

I’m assuming that deepfakes use some kind of automated facial tracking to keep the deepfake in the correct place, angle, and lighting - if that’s right, would that same technology be able to be used in the rotoscoping stage, to seamlessly line up a new facial performance?

My reason for being so curious about this is pretty obvious for fanediting - imagine the scope that would open up if a faneditor could completely replace an entire character’s face and dialogue with their own new actor.

I think that’d be a whole ‘nother level, unless your two clips were at the same angle to begin with.

Hal 9000 said:

I think that’d be a whole ‘nother level, unless your two clips were at the same angle to begin with.

That’s what I’m wondering about - could deepfake technology take a video of a talking head facing camera, and fit it to existing footage.

CaptainFaraday said:

Hal 9000 said:

I think that’d be a whole ‘nother level, unless your two clips were at the same angle to begin with.

That’s what I’m wondering about - could deepfake technology take a video of a talking head facing camera, and fit it to existing footage.

Give em time … to be fair, this technology is mind blowing already.

Edit: I viewed the new shamook stuff and blending it with Burbin’s “filler” shots … and dear lord it’s amazing looking. The movies used a lot of out of focus shots on Tarkin when his face wasn’t straight on that made it pretty dang seamless to do. Wow!

I don’t know if this is where I should ask this, but would it be possible to ‘fix’ the strange TLJ Yoda puppet by deepfaking him with the ESB/ROTJ Yoda?

NeverarGreat said:

I don’t know if this is where I should ask this, but would it be possible to ‘fix’ the strange TLJ Yoda puppet by deepfaking him with the ESB/ROTJ Yoda?

That … would be awesome.

Yes, I remember that one. Would be interesting to see the full deepfake treatment on it, though.

So not to sound expectant or unappreciative, but is anybody working on an edit of the Mandalorian season 2 ending with the deepfake? Just wondering, not sure I saw a straight answer.

Yall are doing the Whill’s work here 😃

BandobrasTuk thanks! but i honestly cannot find it…could you give me a link?