Experts call for more diversity to combat bias in artificial intelligence

Dec 15, 2023, 1:30 PM | Updated: May 28, 2024, 10:59 am

AI is informed by the data it’s built upon and at times that data can be biased and flawed. Exper...

AI is informed by the data it’s built upon and at times that data can be biased and flawed. Experts call for increasing diversity in the field to combat bias in AI. Mandatory Credit: gorodenkoff/iStockphoto/Getty Images

(CNN) — Calvin Lawrence has dedicated his career to artificial intelligence. But even after decades of experience in computer engineering, he said one thing remains incredibly rare.

“I’ve worked on many AI projects over the last 25 years, not more than two [of my colleagues] looked like me,” Lawrence, who is Black, said.

Artificial intelligence holds the promise of rapidly reshaping our society, but with that promise, Lawrence said, comes the challenge of confronting and dismantling biases that can be encoded into emerging technology.

Lawrence is the author of the book, “Hidden in White Sight,” which examines how AI contributes to systemic racism.

AI is informed by the data it’s built upon and at times that data can be racist, sexist and flawed.

In August, a Black mom in Detroit sued the city after she says she was falsely arrested while eight months pregnant because officers linked her to a crime through facial recognition technology. Detroit’s police chief later blamed “poor investigative work.”

A 2022 study found a robot trained by AI was more likely to associate Black men with being criminals, or women with being homemakers. The team of researchers concluded the continued use of such technology risked “amplifying malignant stereotypes” that fuel racism and misogyny.

In New York City, the local health department recently expanded a coalition challenging clinical algorithms that adjust for race because they say the outcomes are often harmful to people of color. These algorithms have been shown to overestimate a person of color’s health, according to a statement from the New York City Department of Health and Mental Hygiene, which can cause a delay in treatment.

In a statement shared with CNN, a spokesperson for OpenAI, the company behind ChatGPT and other artificial general intelligence (AGI) models, said bias is a significant issue across the industry and OpenAI is dedicated to “researching and reducing bias, and other risks, in our models.”

“We are continuously iterating on our models to reduce bias and mitigate harmful outputs,” the company said in a statement, adding that for every new model released, OpenAI publishes research on how they are working to achieve those goals.

The best way to ensure AI reflects the experiences of people of color, Lawrence said, is to make sure they’re employed and engaged in every step of the process.

“You certainly don’t have a lot of Black folks or data scientists participating in the process of deploying and designing AI solutions,” he said. “The only way you can get them to have seats at the table, you have to educate them.”

Increasing diversity

Studies have found that the lack of diversity and representation in technology fields begins well before college. Students of color generally have less access to foundational computer science courses in high school, a 2023 report by the Advocacy Coalition found.

While 89% of Asian students and 82% of White students had access to these courses respectively, 78% of Black and Hispanic and 67% of Native American students had this same privilege.

“These opportunities are not evenly distributed, and that is a problem,” said Andres Lombana-Bermudez, a faculty associate at the Harvard University Berkman Klein Center for Internet and Society.That disparity in access can also lead to fewer people of color studying computer science and artificial intelligence at the collegiate level, Lombana-Bermudez said.

In 2022, more than two-thirds of all doctorates in computer science, computer engineering or information in the United States were awarded to non-permanent U.S. residents for whom no ethnicity is available, according to the 2022 Computing Research Association’s Taulbee Survey.

Nearly 19% of degrees went to White doctoral candidates and 10.1% were awarded to Asian candidates, as compared with only 1.7% for Hispanic graduates and 1.6% for Black graduates.

Lawrence said he believes diversifying the field of artificial intelligence could make the technology safer and more ethical.

Lawrence said he started the nonprofit, AI 4 Black Kids, which works to educate Black children about artificial intelligence and machine learning from a young age, with the hope of one day increasing representation in the field.

“AI is trained on so few historical points of view … the goal for me is, having more Black people involved in that process,” he said.

The nonprofit offers mentorship programs to kids aged 5 to 19, as well as scholarships and college counseling, Lawrence said.

Combating bias in AI requires not only increasing racial diversity, but a diversity of thought as well, Lombana-Bermudez said. He encourages employing sociologists, lawyers, political scientists and other types of humanities-oriented academics to help contribute to the conversation around AI and ethics.

Lombana-Bermudez said his hope is that future generations may alleviate some of the problems of bias and inaccessibility because they’re growing up alongside the technology.

“I am hopeful that this will change and in the future, we will have better technologies,” he said. “But it’s a struggle, and it’s not easy. It is complex.”

We want to hear from you.

Have a story idea or tip? Send it to the KSL NewsRadio team here.

Artificial Intelligence

It’s the first annual Miss AI Pageant. Each of the contestants is so beautiful they could stop tr...

Jeff Caplan

Jeff Caplan’s Minute of News: The Miss AI Pageant

The women are artificial. The prize money is real.

2 days ago

The European Union is about to enact strict new rules to try to prevent misuse of Artificial Intell...

Simone Seikaly

New AI rules for the EU, but the loneliness remains

As the European Union adopts strict rules for Artificial Intelligence, some in America question if AI can replace loneliness.

25 days ago

A cursor hovers above the title ChatGPT on a web browser....

Don Brinkerhoff

BYU study looks at student AI usage

The question of artificial intelligence in the classroom is becoming something nearly all teachers are having to deal with, and a new study by a group of BYU professors looked into how student AI usage has developed on campus.

2 months ago

Artificial intelligence could be the next tool used in mental health therapy....

Amanda Dickson

Artificial intelligence may be able to help with your mental health

University of Utah researchers are working to understand how artificial intelligence and mental health therapists might work together.

2 months ago

Neuroscientist David Eagleman speaks at the University of Utah's Kingsbury Hall on Tuesday as the k...

Sky Mundell, KSL.COM

Neuroscientist David Eagleman proposes test of intelligence for AI to Utah audience

Eagleman spoke as part of the Natural History Museum's lecture series centered around the nature of intelligence.

2 months ago

a laptop shows openai voice engine blog post...

Clare Duffy, CNN

OpenAI says it’s working on AI that mimics human voices

OpenAI shared samples from early tests of Voice Engine, which uses a 15-second sample of someone speaking to generate a convincing replica of their voice.

3 months ago

Sponsored Articles

Underwater shot of the fisherman holding the fish...

Bear Lake Convention and Visitors Bureau

Your Bear Lake fishing guide

Bear Lake offers year-round fishing opportunities. By preparing ahead of time, you might go home with a big catch!

A group of people cut a purple ribbon...


Comcast announces major fiber network expansion in Utah

Comcast's commitment to delivering extensive coverage signifies a monumental leap toward a digitally empowered future for Utahns.

a doctor putting her hand on the chest of her patient...

Intermountain Health

Intermountain nurse-midwives launch new gynecology access clinic

An access clinic launched by Intermountain nurse-midwives provides women with comprehensive gynecology care.

Young couple hugging while a realtor in a suit hands them keys in a new home...

Utah Association of Realtors

Buying a home this spring? Avoid these 5 costly pitfalls

By avoiding these pitfalls when buying a home this spring, you can ensure your investment will be long-lasting and secure.

a person dressed up as a nordic viking in a dragon boat resembling the bear lake monster...

Bear Lake Convention and Visitors Bureau

The Legend of the Bear Lake Monster

The Bear Lake monster has captivated people in the region for centuries, with tales that range from the believable to the bizarre.


Live Nation Concerts

All the artists coming to Utah First Credit Union Amphitheatre (formerly USANA Amp) this summer

Summer concerts are more than just entertainment; they’re a celebration of life, love, and connection.

Experts call for more diversity to combat bias in artificial intelligence