ARTIFICIAL INTELLIGENCE

Some video game actors are letting AI clone their voices. They just don’t want it to replace them

Feb 20, 2024, 7:00 AM | Updated: 9:56 am

Voice actor Sarah Elmaleh poses for a photo in Los Angeles on Thursday, Feb. 1, 2024. Recent years ...

Voice actor Sarah Elmaleh poses for a photo in Los Angeles on Thursday, Feb. 1, 2024. Recent years marked a golden age for making an acting career in video games, but now some studios are looking to use artificial intelligence to clone actors' voices. Voice actors like Elmaleh, who played the Cube Queen in Fortnite, are taking a cautious approach to making sure such arrangements can help actors rather than replace them. (AP Photo/Richard Vogel)

(AP Photo/Richard Vogel)

If you are battling a video game goblin who speaks with a Cockney accent, or asking a gruff Scottish blacksmith to forge a virtual sword, you might be hearing the voice of actor Andy Magee.

Except it’s not quite Magee’s voice. It’s a synthetic voice clone generated by artificial intelligence.

As video game worlds get more expansive, some game studios are experimenting with AI tools to give voice to a potentially unlimited number of characters and conversations. It also saves time and money on the “vocal scratch” recordings game developers use as placeholders to test scenes and scripts.

The response from professional actors has been mixed. Some fear that AI voices could replace all but the most famous human actors if big studios have their way. Others, like Magee, have been willing to give it a try if they’re fairly compensated and their voices aren’t misused.

“I hadn’t really anticipated AI voices to be my break into the industry, but, alas, I was offered paid voice work, and I was grateful for any experience I could get at the time,” said Magee, who grew up in Northern Ireland and has previously worked as a craft brewery manager, delivery driver and farmer.

He now specializes in voicing a diverse range of characters from the British Isles, turning what he used to consider a party trick into a rewarding career.

AI voice clones don’t have the best reputation, in part because they’ve been misused to create convincing deepfakes of real people — from U.S. President Joe Biden to the late Anthony Bourdain — saying things they never said. Some early attempts by independent developers to add them to video games have also been poorly received, both by gamers and actors — not all of whom consented to having their voices used in that way.

Most of the big studios haven’t yet employed AI voices in a noticeable way and are still in ongoing negotiations on how to use them with Hollywood’s actors union, which also represents game performers. Concerns about how movie studios will use AI helped fuel last year’s strikes by the Screen Actors Guild-American Federation of Television and Radio Artists but when it comes to game studios, the union is showing signs that a deal is likely.

Sarah Elmaleh, who has played the Cube Queen in Fortnite and numerous other high-profile roles in blockbuster and indie games, said she has “always been one of the more conservative voices” on AI-generated voices but now considers herself more agnostic.

“We’ve seen some uses where the (game developer’s) interest was a shortcut that was exploitative and was not done in consultation with the actor,” said Elmaleh, who chairs SAG-AFTRA’s negotiating committee for interactive media.

in other cases, she said, the role of an AI voice is often invisible and used to clean up a recording in the later stages of production, or to make a character sound older or younger at a different stage of their virtual life.

“There are use cases that I would consider with the right developer, or that I simply feel that the developer should have the right to offer to an actor, and then an actor should have the right to consider that it can be done safely and fairly without exploiting them,” Elmaleh said.

SAG-AFTRA has already made a deal with one AI voice company, Replica Studios, announced last month at the CES gadget show in Las Vegas. The agreement — which SAG-AFTRA President Fran Drescher described as “a great example of AI being done right” — enables major studios to work with unionized actors to create and license a digital replica of their voice. It sets terms that also allow performers to opt out of having their voices used in perpetuity.

“Everyone says they’re doing it with ethics in mind,” but most are not and some are training their AI systems with voice data pulled off the internet without the speaker’s permission, said Replica Studios CEO Shreyas Nivas.

Nivas said his company licenses characters for a period of time. To clone a voice, it will schedule a recording session and ask the actor to voice a script either in their regular voice or the voice of the character they are performing.

“They control whether they wish to go ahead with this,” he said. “It’s creating new revenue streams. We’re not replacing actors.”

It was Replica Studios that first reached out to Magee about a voice-over audio clip he had created demonstrating a Scottish accent. Working from his home studio in Vancouver, British Columbia, he’s since created a number of AI replicas and pitched his own ideas for them. For each character he’ll record lines with distinct emotions — some happy, some sad, some in battle duress. Each mood gets about 7,000 words, and the final audio dataset amounts to several hours covering all of a character’s styles.

Once cloned, a paid subscriber of Replica’s text-to-speech tool can make that voice say pretty much anything — within certain guidelines.

Magee said the experience has opened doors to a range of acting experiences that don’t involve AI — including a role in the upcoming strategy game Godsworn.

Voice actor Zeke Alton, whose credits include more than a dozen roles in the Call of Duty military action franchise, hasn’t yet agreed to lending his voice to an AI replica. But he understands why studios might want them as they try to scale up game franchises such as Baldur’s Gate and Starfield where players can explore vast, open worlds and encounter elves, warlocks or aliens at every corner.

“How do you populate thousands of planets with walking, talking entities while paying every single actor for every single individual? That just becomes unreasonable at a point,” said Alton, who also sits on the SAG-AFTRA negotiating committee for interactive media.

Alton is also open to AI tools that reduce some of the most physically straining work in creating game characters — the grunts, shouts and other sounds of characters in battle, as well as the movements of jumping, striking, falling and dying required in motion-capture scenes.

“I’m one of those people that is not interested so much in banning AI,” Alton said. “I think there’s a way forward for the developers to get their tools and make their games better, while bringing along the performers so that we maintain the human artistry.”

We want to hear from you.

Have a story idea or tip? Send it to the KSL NewsRadio team here.

Artificial Intelligence

Artificial intelligence could be the next tool used in mental health therapy....

Amanda Dickson

Artificial intelligence may be able to help with your mental health

University of Utah researchers are working to understand how artificial intelligence and mental health therapists might work together.

21 hours ago

Neuroscientist David Eagleman speaks at the University of Utah's Kingsbury Hall on Tuesday as the k...

Sky Mundell, KSL.COM

Neuroscientist David Eagleman proposes test of intelligence for AI to Utah audience

Eagleman spoke as part of the Natural History Museum's lecture series centered around the nature of intelligence.

8 days ago

a laptop shows openai voice engine blog post...

Clare Duffy, CNN

OpenAI says it’s working on AI that mimics human voices

OpenAI shared samples from early tests of Voice Engine, which uses a 15-second sample of someone speaking to generate a convincing replica of their voice.

15 days ago

nick clegg...

Associated Press

Tech companies sign accord to combat AI-generated election trickery

Tech executives from Amazon, Google, Meta, Microsoft, OpenAI and TikTok gathered to announce a new framework for responding to AI-generated deepfakes.

2 months ago

jordan school district building shown, the district will have ai in its schools...

Heather Peterson

Jordan School District joins program to use AI in classrooms

The Jordan School District is now one of 1500 school districts in America using AI as a tool in their classrooms.

2 months ago

deepfake...

Curt Gresseth

After deepfake porn images target Taylor Swift, is it safe to post photos of kids online?

After deepfake AI-generated pornographic images of Taylor Swift raced across the internet, a question arises: Is it safe to post images of kids online?

3 months ago

Sponsored Articles

a person dressed up as a nordic viking in a dragon boat resembling the bear lake monster...

Bear Lake Convention and Visitors Bureau

The Legend of the Bear Lake Monster

The Bear Lake monster has captivated people in the region for centuries, with tales that range from the believable to the bizarre.

...

Live Nation Concerts

Artists coming to Utah First Credit Union Amphitheatre (formerly USANA Amp) this summer

Summer concerts are more than just entertainment; they’re a celebration of life, love, and connection.

Mother and cute toddler child in a little fancy wooden cottage, reading a book, drinking tea and en...

Visit Bear Lake

How to find the best winter lodging in Bear Lake, Utah

Winter lodging in Bear Lake can be more limited than in the summer, but with some careful planning you can easily book your next winter trip.

Happy family in winter clothing at the ski resort, winter time, watching at mountains in front of t...

Visit Bear Lake

Ski more for less: Affordable ski resorts near Bear Lake, Utah

Plan your perfect ski getaway in Bear Lake this winter, with pristine slopes, affordable tickets, and breathtaking scenery.

front of the Butch Cassidy museum with a man in a cowboy hat standing in the doorway...

Bear Lake Convention and Visitors Bureau

Looking Back: The History of Bear Lake

The history of Bear Lake is full of fascinating stories. At over 250,000 years old, the lake has seen generations of people visit its shores.

silhouette of a family looking over a lake with a bird in the top corner flying...

Bear Lake Convention and Visitors Bureau

8 Fun Activities To Do in Bear Lake Without Getting in the Water

Bear Lake offers plenty of activities for the whole family to enjoy without having to get in the water. Catch 8 of our favorite activities.

Some video game actors are letting AI clone their voices. They just don’t want it to replace them