AP

Facebook bans deepfakes in fight against online manipulation

Jan 8, 2020, 7:08 AM

confirmation bias...

FILE - This March 29, 2018 file photo, shows the logo for social media giant Facebook at the Nasdaq MarketSite in New York's Times Square. Facebook said Monday Jan. 6, 2020 that it is banning “deepfake” videos, the false but realistic clips created with artificial intelligence and sophisticated tools, as it steps up efforts to fight online manipulation. (AP Photo/Richard Drew, File)

(AP Photo/Richard Drew, File)

LONDON (AP) — Facebook says it is banning “deepfake” videos, the false but realistic clips created with artificial intelligence and sophisticated tools, as it steps up efforts to fight online manipulation. But the policy leaves plenty of loopholes.

The social network said late Monday that it’s beefing up its policies for removing videos edited or synthesized in ways that aren’t apparent to the average person, and which could dupe someone into thinking the video’s subject said something he or she didn’t actually say.

Created by artificial intelligence or machine learning, deepfakes combine or replace content to create images that can be almost impossible to tell are not authentic.

“While these videos are still rare on the internet, they present a significant challenge for our industry and society as their use increases,” Facebook’s vice president of global policy management, Monika Bickert, said in a blog post.

However, she said the new rules won’t include parody or satire, or clips edited just to change the order of words. The exceptions underscore the balancing act Facebook and other social media services face in their struggle to stop the spread of online misinformation and “fake news,” while also respecting free speech and fending off allegations of censorship.

The U.S. tech company has been grappling with how to handle the rise of deepfakes after facing criticism last year for refusing to remove a doctored video of House Speaker Nancy Pelosi slurring her words, which was viewed more than 3 million times. Experts said the crudely edited clip was more of a “cheap fake” than a deepfake.

Then, a pair of artists posted fake footage of Facebook CEO Mark Zuckerberg showing him gloating over his one-man domination of the world. Facebook also left that clip online. The company said at the time that neither video violated its policies.

The problem of altered videos is taking on increasing urgency as experts and lawmakers try to figure out how to prevent deepfakes from being used to interfere with the U.S. presidential election in November.

The new policy is a “strong starting point,” but doesn’t address broader problems, said Sam Gregory, program director at Witness, a nonprofit working on using video technology for human rights.

“The reality is there aren’t that many political deepfakes at the moment,” he said. “They’re mainly nonconsensual sexual images.”

The bigger problem is videos that are either shown without context or lightly edited, which some have dubbed “shallow fakes,” Gregory said. These include the Pelosi clip or one that made the rounds last week of Democratic presidential candidate Joe Biden that was selectively edited to make it appear he made racist remarks.

Gregory, whose group was among those that gave feedback to Facebook for the policy, said that while the new rules look strong on paper, there are questions around how effective the company will be at uncovering synthetic videos.

Facebook has built deepfake-detecting algorithms and can also look at an account’s behavior to get an idea of whether it’s intention is to spread disinformation. That will give the company an edge over users or journalists in sniffing them out, Gregory said.

But those algorithms haven’t been used widely for deepfakes in the wild. “So it is an open question how effective detection will be,” he said. “This is an algorithmic kind of game of cat and mouse, where the forgeries will get better alongside the detection.”

Facebook said any videos, deepfake or not, will also be removed if they violate existing standards for nudity, graphic violence or hate speech. Those that aren’t removed can still be reviewed by independent third-party fact-checkers and any deemed false will be flagged as such to people trying to share or view them, which Bickert said was a better approach than just taking them down.

“If we simply removed all manipulated videos flagged by fact-checkers as false, the videos would still be available elsewhere on the internet or social media ecosystem,” Bickert said. “By leaving them up and labeling them as false, we’re providing people with important information and context.”

Twitter, which has been another hotbed for misinformation and altered videos, said it’s in the process of creating a policy for “synthetic and manipulated media,” which would include deepfakes and other doctored videos. The company has asked for public feedback on the issue. The responses it’s considering include putting a notice next to tweets that include manipulated material. The tweets might also be removed if they’re misleading and could cause serious harm to someone.

YouTube, meanwhile, has a policy against “deceptive practices” that the company says includes the “deceptive uses of manipulated media” that may pose serious risk of harm. For instance, the company removed the Pelosi video last year. Google, which owns YouTube, is also researching how to better detect deepfakes and other manipulated media.

___

For all of AP’s tech coverage, visit https://apnews.com/apf-technology

___

Follow Kelvin Chan at www.twitter.com/chanman

___

AP Technology Writer Barbara Ortutay contributed to this story from San Francisco.

We want to hear from you.

Have a story idea or tip? Send it to the KSL NewsRadio team here.

AP

FILE - Hannah Gutierrez-Reed, the former armorer for the Western film "Rust," listens to closing ar...

MORGAN LEE Associated Press

Movie armorer seeks dismissal of her conviction or new trial in fatal shooting by Alec Baldwin

'Rust' armorer seeks to dismiss her involuntary manslaughter conviction or convene a new trial after dismissal of Alec Baldwin's case.

7 days ago

Republican presidential candidate former President Donald Trump is covered by U.S. Secret Service a...

JULIE CARR SMYTH, JILL COLVIN, COLLEEN LONG, MICHAEL BALSAMO, ERIC TUCKER and MICHELLE L. PRICE Associated Press

Local officer encountered gunman just before he shot toward Trump at rally, sources tell AP

One local police officer climbed to the roof and encountered the shooter, who pointed his rifle at the officer, AP sources say.

10 days ago

FILE - In this combination of photos, President Joe Biden speaks on Aug. 10, 2023, in Salt Lake Cit...

Associated Press

Debate takeaways: Trump confident, even when wrong, Biden halting, even with facts on his side

Thursday’s presidential debate was a re-run that featured two candidates with a combined age of 159, but it went poorly for one of them.

26 days ago

Supreme Court Police officers stand on duty outside of the Supreme Court building on Thursday, June...

MARK SHERMAN, Associated Press

The Supreme Court upholds a gun control law intended to protect domestic violence victims

The Supreme Court has upheld a federal gun control law on Friday with intentions to protect domestic violence victims.

1 month ago

A photo taken of Matthew Perry in 2022....

Clayre Scott

Criminal investigation opened in relation to Matthew Perry’s death

A criminal investigation has been opened in relation to Matthew Perry's death due to high levels of ketamine found in his blood.

2 months ago

FILE - The United Nations (UN) headquarters are pictured in Geneva, Switzerland, Friday, Sept. 9, 2...

EDITH M. LEDERER, Associated Press

U.N. to vote on resolution that would grant Palestine new rights

The U.N. General Assembly is expected to vote Friday on a resolution that would grant new "rights and privileges" to Palestine.

3 months ago

Sponsored Articles

A young woman smiles while reading the menu at a lakeside restaurant, enjoying the panoramic view o...

Bear Lake Convention & Visitors Bureau

The best restaurants to try in Bear Lake

Save this guide to the best restaurants in Bear Lake when you need to find a place to dine during your next visit.

Female leg stepping on weigh scales. Healthy lifestyle, food and sport concept....

Health Utah

Sustainable weight loss: the science-backed way to achieve it

Learn more about Debbie's weight loss journey with Health Utah, who have a unique weight loss philosophy for success.

Underwater shot of the fisherman holding the fish...

Bear Lake Convention and Visitors Bureau

Your Bear Lake fishing guide

Bear Lake offers year-round fishing opportunities. By preparing ahead of time, you might go home with a big catch!

A group of people cut a purple ribbon...

Comcast

Comcast announces major fiber network expansion in Utah

Comcast's commitment to delivering extensive coverage signifies a monumental leap toward a digitally empowered future for Utahns.

a doctor putting her hand on the chest of her patient...

Intermountain Health

Intermountain nurse-midwives launch new gynecology access clinic

An access clinic launched by Intermountain nurse-midwives provides women with comprehensive gynecology care.

Young couple hugging while a realtor in a suit hands them keys in a new home...

Utah Association of Realtors

Buying a home this spring? Avoid these 5 costly pitfalls

By avoiding these pitfalls when buying a home this spring, you can ensure your investment will be long-lasting and secure.

Facebook bans deepfakes in fight against online manipulation