logo Sign In

Using AI Voices to Repair Deleted Scenes (RotJ Sandstorm, Yoda Communes with Qui-Gon, etc.)

Author
Time

This is less of an “I am doing this” and more of a “here’s an idea that people with more experience than me might want to try out.” I recently used ElevenLabs AI voice cloning to create a rough mock-up of the Return of the Jedi sandstorm scene with audible dialogue. It’s far from perfect, but I think it’s a decent proof of concept.

I got to wondering if more talented people in the community might be able to use this to fix up more deleted scenes. The ones that specifically came to mind were:

If anyone has ideas for any other scenes that could benefit from this, or would like to try their hand at it, please share below! Here are some additional links that might be helpful:

I’ve found that ElevenLabs struggles with voices that aren’t humans with American accents. I’ve had no luck with replicating the voices of Yoda, Greedo, C-3PO, Motti, Tagge, or Obi-Wan. But the technology is ever-evolving, so maybe someday soon!

Author
Time

Hey man, just wanted to say I was so impressed with your work on that ROTJ deleted scenes and I appreciate you sharing your work here! I honestly feel like it is good enough to use in an edit, especially if you slightly muffled some of the weaker spots with the sandstorm sfx.

For the “Vader Widens the Search”, I feel like someone could hire that Ryan Golden voice actor that Star Wars Story used for the Rogue One Vader scene.

Author
Time

Wow that’s super impressive on the sandstorm scene. Only rough spot I noticed was Luke’s tone not really matching his demeanor for part of it. Great work!

Author
Time

With the Yoda/Qui-Gon scene, you can pull lines from the Clone Wars episode with Liam Neeson as the whole thing is much the same, so there’s not much need for AI, unless you want the lines exactly as scripted.

https://vimeo.com/406776742

But you’ve done a great job with all your created lines, the sandstorm scene especially sounds great!

Author
Time

I have an old fanedit that someone did of Jedi that had a restored sandstorm, am pretty sure AI wasn’t used and the result was great.