logo Sign In

Info: Nvidia RTX Voice for Music Removal

Author
Time
 (Edited)

Ok guys, got some awesome news. Nvidia just released RTX voice, an AI noise suppression algorithm, I have just tested it on the Order 66 scene from ROTS and was able to remove the music. Trying to fiddle with it to see if I can keep SFX in place a bit better.

There are rumors that this can run on non RTX hardware, ; ) the net is your friend. Apparently it used CUDA and Nvidia just artificially locked it to RTX only GPUs.

Author
Time
 (Edited)

Can it run on a shitty hp laptop?

Peace is a lie
There is only passion…

Author
Time

If your laptop has a 10 series pascal GPU, or a later Fermi 750-780 it should run, but you need to follow these instructions to get it working

https://forums.guru3d.com/threads/nvidia-rtx-voice-works-without-rtx-gpu-heres-how.431781/ (its a bit of a pain in the ass, but it works.)

@Tantive3+1 I’m trying to get a clip together, but I think this should be tried by some of the more experienced editors here. Trying to put a demonstration together.

It is remarkably easy, but its hard to keep detailed SFX intact without a hint of music getting through. Way more effective than anything I have seen from a plug and play solution, some scenes work better than others.

Author
Time

Promising indeed.

Peace is a lie
There is only passion…

Author
Time

I’ve always hoped for something like this. I have wanted to reedit the Battle of Yavin as close to the fourth draft script as possible and there is much that can be done to make this possible, but the audio really makes it sound terrible. Perhaps I will finally get this done!

Author
Time

Ok so this might be a dumb question, but is there any possible way to enhance the audio from ANH using AI. The dialogue for much of the film sounds like its coming out of a tin can. Particularly during the floating droid training scene when Luke says “You mean it controls your actions?”. I don’t know, it’s just always really bothered me.

I mean is this what this program can be used for? Or just music removal?

Author
Time

SWOTFAN25 said:

Ok so this might be a dumb question, but is there any possible way to enhance the audio from ANH using AI. The dialogue for much of the film sounds like its coming out of a tin can. Particularly during the floating droid training scene when Luke says “You mean it controls your actions?”. I don’t know, it’s just always really bothered me.

I mean is this what this program can be used for? Or just music removal?

I don’t really think it’s used for that. Other than additional EQ-ing I don’t know what can be done for the dialogue in ANH…it’s driven me nuts for years. I’m NOT an expert but, I mean, couldn’t they at least bring it up to ESB quality?

SSWR’s YouTube channel

Attack of the Clones: Alternate Timeline Edit Thread:
https://originaltrilogy.com/topic/SSWRs-Attack-of-the-Clones-Alternate-Timeline-Edit/id/66888

Author
Time

SWOTFAN25 said:

Ok so this might be a dumb question, but is there any possible way to enhance the audio from ANH using AI. The dialogue for much of the film sounds like its coming out of a tin can. Particularly during the floating droid training scene when Luke says “You mean it controls your actions?”. I don’t know, it’s just always really bothered me.

I mean is this what this program can be used for? Or just music removal?

An AI model probably could be generated for that purpose if it were designed to do so. Unfortunately, this tool is just meant for ambient noise removal in apps like OBS. Turns out it had a neat side effect for our purposes though.