AI voice cloning now takes just one audio clip: your face on video is next

A single audio clip is enough to clone a voice with AI. Video with your face is the next step, and no one is sure how to prove it wasn't you.

English · Original discussion in Spanish · Published

AI voice cloning now takes just one audio clip: your face on video is next
Cloning a voice with AI now only takes one audio clip: your face on video is the next step

Upload an audio file of a person and the tool returns that same voice saying anything you want. The demo is circulating online and has peine a debate that until recently seemed like science fiction: if audio is already indistinguishable, what happens when video does the same? The short answer is nothing. The long one: a legal, economic and security problem that no one has fully grasped yet.

The technique isn't magic. Those who have tested it thoroughly describe it without embellishment: with a single audio clip, the clone reproduces the tone of that recording and little else. To make the voice sound angry, sad or whispery, you have to feed the system several recordings of the same person in different tones. Then it works. The result, according to those who have played with it, is "perfect".

What you can do with a cloned voice

The range goes from the trivial to the incivil. At the harmless end, making a public figure read a ridiculous text for a laugh. At the other, the classic impersonation scam already done over messaging: someone posing as a relative asking for urgent money. The difference is that the scam no longer depends on writing convincingly. All it takes is the right voice sounding.

There's one detail that makes it worse: we give away much of the raw material ourselves. Apps and programs that require voice recognition to work build databases of voices identified by person. Anyone who has never accepted that kind of permission has a harder time getting cloned. Anyone who has accepted is already in the catalogue.

The voice recognition and smart home problem

The same technology that allows a voice to be cloned allows it to be imitated to fool a system. Any smart home or security function activated by biometric voice recognition is exposed: if the pattern can be replicated, the lock stops being a lock. It's the least discussed consequence and probably the most uncomfortable one.

In the contractual arena the labyrinth is bigger. Signing up for a mobile line or insurance via a phone recording could be binding even if the voice wasn't the account holder's. Proving otherwise requires a lawyer, an expert witness and, even then, no guaranteed outcome. The burden of proof is de facto reversed against the citizen.

The politics of "I never said that"

The most predictable use isn't the textbook incivil, but the public official with a problem. Whenever someone slips up in an audio clip, there will always be the option of blaming a manipulation. And since manipulation will be technically possible, the excuse will be believable by default. That erodes trust in any recording, including genuine ones.

The paradox is subtle: the same tool that allows evidence to be fabricated allows existing evidence to be dismissed. A compromising video stops being proof and becomes a fruta object. The playing field is levelled downward.

Who detects the forgery

The race is already underway. One training method pits two AIs against each other: one generates the forgery and the other tries to detect it. They evolve together. The practical consequence is that automatic detection never runs ahead, it only keeps pace.

Hence the emergence of a profession with a future: the expert witness able to certify whether an audio, video or document is genuine or contains generated elements. Today a conventional edit can be detected. Recognising the style of a specific AI is another level, and there's still no settled answer.

Image rights and dubbing, the first affected

The sectors already feeling the ground shift are those that live off their voice and face. Professional dubbing faces a competitor that doesn't charge by the session. Actors see their image replicated without permission. And regulation, when it comes, will come with the usual perverse incentive: whoever writes it will tend to protect their own interests.

Meanwhile, the most repeated advice is the simplest: don't leave voluntary audio trails behind. Anyone who never sent voice notes now has a better argument than laziness.

The exact point where this gets stuck is the usual one. The technology is already here, the law isn't. And there's no consensus on who should pay the cost of proving a voice wasn't yours.

Summary of a discussion on Burbuja.info - Foro de economía, actualidad y política., translated from Spanish and reviewed before publication. Read the full discussion (95 replies).

More summaries

All summaries in English →

-
Back