CorentinJ: Real-Time Voice Cloning (2021)

For some reason the VibeVoice model from Microsoft (which is also able to clone voices and is also very good) has been deleted from GitHub 10 days ago even tough it was released under a MIT license. But this post shows that the cat is out of the bag for some time already now (post is from 2021) and we have to live with this technology.

▲

qwertox 3 days ago | parent | next [-]

The reason is known: "we discovered instances where the tool was used in ways inconsistent with the stated intent"

▲

askl 2 days ago | parent [-]

The stated intend would be scamming people I guess? What would be the other ways inconsistent with that?

▲

numpad0 2 days ago | parent [-]

NSFW? That seems to be a bigger deal on the Internet today than scams, somehow.

▲

frank_nitti 2 days ago | parent [-]

Honest question - is NSFW just a code word for pornography now?

I had thought it would be anything that isn’t safe to open at work, including things with extreme profanity or gore, etc

	▲	numpad0 2 days ago \| parent [-]
		To me, the word feel like it's almost a synonym for anime, pornographic or not, with a hint of negativity.

▲

whimsicalism 2 days ago | parent | prev | next [-]

there are many easy extant ways to do voice coding. many models are released without a “voice embedding” model but they are easy to recreate by passing the gradients through the soft prompt

▲

shazron a day ago | parent | prev | next [-]

Try Modelscope.

▲

nickthegreek 3 days ago | parent | prev [-]

any links still up?

▲

hleszek 3 days ago | parent | next [-]

https://github.com/Enemyx-net/VibeVoice-ComfyUI

▲

cchance 3 days ago | parent [-]

And that's why people need to clone these repos from big companies when their first released.

▲

anonymousiam 3 days ago | parent [-]

Cloning the repo isn't enough, because Microsoft/Github still control the platform, and can delete all copies they have control over.

▲

dceddia 3 days ago | parent [-]

Cloning the repo (running git clone on your computer) is enough because it makes a local copy. Forking merely makes a copy under your account on GitHub though which is not going to survive if they go on a deleting spree.

	▲	anonymousiam 2 days ago \| parent [-]
		Yes, you are correct. I used the word "clone" when I should have used the word "fork" instead.

▲

woadwarrior01 2 days ago | parent | prev [-]

There's a community maintained fork.

https://github.com/vibevoice-community/VibeVoice

▲

ivape 2 days ago | parent | prev | next [-]

Does anyone know for sure if Voice ID has security measures to protect against AI voice cloning?

▲

3 days ago | parent | prev | next [-]

[deleted]

▲

macawfish 3 days ago | parent | prev [-]

Atomic bomb level technological shifts happening, open sourced online. What a time to be alive!

▲

avereveard 3 days ago | parent [-]

(2021)

▲

niek_pas 3 days ago | parent | next [-]

In fact, the YouTube video the GitHub repo links to is from 2019.

▲

jasonjmcghee 3 days ago | parent [-]

Papers are all from 2017-2018

▲

macawfish 2 days ago | parent [-]

Doesn't change the fact that it's really epic

	▲	jasonjmcghee 2 days ago \| parent [-]
		The way you wrote your comment/ the chosen example gives the vibe of "this is super dangerous"- and that it's actively happening, so everyone is pointing out this stuff is from a while ago.

▲

p2detar 3 days ago | parent | prev [-]

It looks rather complete, but indeed - the project has 3 commits for the past 3 years.