logo Sign In

Deepfake Ideas - Index and Discussion — Page 5

Author
Time

Master Lawdog said:

After some tinkering and training, I’ve officially given up on putting Samuel L. Jackson’s face onto the background fill-in. It would just be better to digitally map Jackson’s face onto him. I’m moving onto my planned Qui-Gon deepfake, which I may upload to my YouTube channel.

I tried tipping my toes into deepfaking to replace the double’s face for my edit. I think the algorithm doesn’t like faces far away in the picture. It managed to only generate a frame here and there. I ended up using those frames as reference for where the new face should be and just masked Samuel’s face to the shots using Ep2’s deleted scene for the face footage.

Author
Time

I just stumbled upon this and was blown away. It uses this AI to create remarkably clear dialogue, and based on the spot-on pronunciation of the made-up words in that sample as well as some words which were clearly misread, this example was made by speaking the words to the AI and having the AI tune the voice to a specific character. If this is true, then it is a vast improvement over the FakeYou AI which failed to make the cut in my edit.

So what do you think? I’m thinking about a few choice discussions in the OT and how they could be transformed with a few edits from this AI.

You probably don’t recognize me because of the red arm.
Episode 9 Rewrite, The Starlight Project (Released!) and ANH Technicolor Project (Released!)

Author
Time

NeverarGreat said:

I just stumbled upon this and was blown away. It uses this AI to create remarkably clear dialogue, and based on the spot-on pronunciation of the made-up words in that sample as well as some words which were clearly misread, this example was made by speaking the words to the AI and having the AI tune the voice to a specific character. If this is true, then it is a vast improvement over the FakeYou AI which failed to make the cut in my edit.

So what do you think? I’m thinking about a few choice discussions in the OT and how they could be transformed with a few edits from this AI.

I saw the demo they had on YouTube with Leonardo Dicaprio with the voices of various other famous people. It seemed okay, but someone needs to test this out instead of relying upon their very limited samples they provide.

In general, mimicking a human voice will be far more difficult than deepfaking an appearance considering the uniqueness of every voice. I am skeptical, but I hope this shows promise [and will only be used ethically].

Author
Time

NeverarGreat said:

I just stumbled upon this and was blown away. It uses this AI to create remarkably clear dialogue, and based on the spot-on pronunciation of the made-up words in that sample as well as some words which were clearly misread, this example was made by speaking the words to the AI and having the AI tune the voice to a specific character. If this is true, then it is a vast improvement over the FakeYou AI which failed to make the cut in my edit.

So what do you think? I’m thinking about a few choice discussions in the OT and how they could be transformed with a few edits from this AI.

I don’t know the original but it sounded very human-like. I’d be interested to hear some for our main characters. I did some work a while back to isolate all the Jar Jar voice lines so if this is trainable I have them on hand.

The Clone Wars: Refocused | Andor: Movie Omnibus

Author
Time

Have there been improvements on the tarkin leia and Kevin Flynn deepfakes from rogue one and tron legacy?

Author
Time

NeverarGreat said:

I just stumbled upon this and was blown away. It uses this AI to create remarkably clear dialogue, and based on the spot-on pronunciation of the made-up words in that sample as well as some words which were clearly misread, this example was made by speaking the words to the AI and having the AI tune the voice to a specific character. If this is true, then it is a vast improvement over the FakeYou AI which failed to make the cut in my edit.

So what do you think? I’m thinking about a few choice discussions in the OT and how they could be transformed with a few edits from this AI.

I have a voice library for Carrie Fisher/Leia right now. I literally just put an entire 2 hours+ of her reading her book as input. Here is a clip I created:
https://youtu.be/-LzqBD8--H4

Author
Time
 (Edited)

I’m currently trying to get her to say, “It belongs to you now” when she gives Rey the lightsaber before leaving the Resistance base.

EDIT: If anybody has Leia line ideas throughout the sequel trilogy I’m willing to give them a shot. Still have 30,000 words left.

Author
Time

Having played with this myself, it’s scary how well this works. I’m having some existential feelings about some of the work I’ve done before this tbh

Andor: The Rogue One Arc

Author
Time

Yup, “this lightsaber belongs to you now” is definitely better. I’ll try that out.

Author
Time

I think that’s just unfortunately a side effect of the source material - her reading a book. Not a lot of opportunity to be whispering there. I think the first clip I posted managed to get her to somewhat whisper due to the way the AI had her deliver the line. But after regenerating other lines a bunch of times I haven’t been able to get a similar effect.

Author
Time

Well I was pretty disappointed to find out that you have to pay to use Eleven Labs’ voice cloning tool.

The name’s Lawson. Noah Lawson.

Author
Time

Pro tip: you don’t. It just requires credit card information because you get the 5 dollar plan free for the first month. You just cancel next month’s payment as soon as you “purchase” the free month.

Author
Time

Jar Jar Bricks said:

Pro tip: you don’t. It just requires credit card information because you get the 5 dollar plan free for the first month. You just cancel next month’s payment as soon as you “purchase” the free month.

You’re probably going to have to tell me this stuff in a PM. I’m a bit cautious paying for something like this.

The name’s Lawson. Noah Lawson.

Author
Time

Now that AI voicing is totally a thing, we have a real opportunity to rethink Jar Jar’s dialogue. Back when Iwas experimenting with his existing/Clone Wars lines, I realised that one of the main issues with him (other than being annoying) was that he doesn’t have much agency, or obvious desires. Does anyone have any ideas for alternate Jar Jar lines which would fit?

The Clone Wars: Refocused | Andor: Movie Omnibus

Author
Time

You could give him an arc about wanting to redeem himself in the eyes of his people, which he fulfills by the end. Have him lament his exile and try to apologize to Boss Nass.

Author
Time

You know, that’s not a bad idea. Issue with Jar Jar is that nobody really meaningfully interacts with him. And he’s still an idiot. But what if he’s on a kind of personal quest, kind of like the Quarian pilgrimage from Mass Effect, where they leave the tribe in order to find and bring back something of value? And what if he- perhaps in an extremely naive way- decides he’s going to seek Padmé so he can make peace between the Naboo and the Gungans?

It’s a very naive, overly optimistic thing, which the audience and other characters can pass off as being silly, and they can completely dismiss him.

But, it would explain why he’s eager to join/guide the Jedi to Padmé, why he sticks around, and ultimately why he suggests the Gungan army to Padmé.

In his scene where he meets Obi-Wan and Qui-Gon, he could clumsily explain part of this - “Mesa on a personal quest, but then thesa droids attacking, and mesa getting lost!”, into leading them to Theed.

In the scene where Padmé asks Jar Jar why he’s still with them, he could explain it more clearly- that he’s seeking her because he wants to make peace. Her facial expressions there give the impression that she thinks he’s cute- but dismissable.

Padmé and Jar Jar have a more serious conversation on Coruscant about their peoples, which also could include a little extra.

Then, you wouldn’t need to do much more- Padmé and the Gungan king would talk as before, and at the end he’d declare “Peace!” to Jar Jar’s cheers.

The Clone Wars: Refocused | Andor: Movie Omnibus

Author
Time

EddieDean said:

You know, that’s not a bad idea. Issue with Jar Jar is that nobody really meaningfully interacts with him. And he’s still an idiot. But what if he’s on a kind of personal quest, kind of like the Quarian pilgrimage from Mass Effect, where they leave the tribe in order to find and bring back something of value? And what if he- perhaps in an extremely naive way- decides he’s going to seek Padmé so he can make peace between the Naboo and the Gungans?

It’s a very naive, overly optimistic thing, which the audience and other characters can pass off as being silly, and they can completely dismiss him.

But, it would explain why he’s eager to join/guide the Jedi to Padmé, why he sticks around, and ultimately why he suggests the Gungan army to Padmé.

In his scene where he meets Obi-Wan and Qui-Gon, he could clumsily explain part of this - “Mesa on a personal quest, but then thesa droids attacking, and mesa getting lost!”, into leading them to Theed.

In the scene where Padmé asks Jar Jar why he’s still with them, he could explain it more clearly- that he’s seeking her because he wants to make peace. Her facial expressions there give the impression that she thinks he’s cute- but dismissable.

Padmé and Jar Jar have a more serious conversation on Coruscant about their peoples, which also could include a little extra.

Then, you wouldn’t need to do much more- Padmé and the Gungan king would talk as before, and at the end he’d declare “Peace!” to Jar Jar’s cheers.

Wow you figured out a way to make jar jar a character instead of a lame joke character.

Author
Time

There’s a phrase that’d lipsync right with Jar Jar’s mouth movements in his conversation with Padmé: “Why are you here?” “Me no know. Mesa think that if the Gungans and the people of Naboo would just talk, then boom! We could have a chance at peace!” [Padmé smiles]

The Clone Wars: Refocused | Andor: Movie Omnibus