Hey Alexa, are you listening to me?

Apr 11, 2019, 1:59 PM | Updated: Apr 12, 2019, 5:57 am

SALT LAKE CITY — Yes, Alexa is listening to you — and the smart speaker-turned-personal assistant isn’t the only one.

Amazon’s Alexa is one of the many now prevalent digital assistants meant to make your life easier and answer simple questions about your upcoming calendar appointments, or set timers and alarms, and even change the temperature or turn on your wi-fi connected smart home appliances.

Much of the ability of these digital assistants come from the vast computing power that Amazon has to run speech recognition software to change your voice into 1’s and 0’s that Alexa can understand. But to anyone who’s familiar with trying to ask the device a simple question knows, sometimes it’s incredibly frustrating.

“Somewhere along the way someone has to annotate that data that’s coming in,” Matt Day from Bloomberg News said.

Designated employees go in and see how much of what you said to the machine was heard correctly. They transcribe and annotate other snippets from conversations and questions to make sure that Alexa is understanding them properly, then feed that information back into the system. The goal: to keep teaching Alexa to be better at answering even the simplest questions, like what the weather is going to be like tomorrow.

“People are saying billions of things into Alexa [Amazon] says, and it’s going to pick up accidentally a ton of stuff including some disturbing things or some funny things,” Day said.

Day said those who work for Amazon across the globe have heard things like children crying, poor singing in the shower, and what, at times, may have been a sexual assault.

This process isn’t something that is unheard of, though. In the tech world, this form of processing is broadly known as ‘supervised learning’ when a human is involved, and when it is paired with other machine learning is known as ‘semi-supervised learning’.

There are thousands of these employees hired to listen and transcribe recordings captured by Amazon’s line of Echo speakers. Bloomberg reports those employees are transcribing up to 1,000 audio clips during their 9-hour shifts every day.

According to Bloomberg, several people that had reportedly worked for the internet giant said that the recordings are associated with the customer’s first name, device serial number, and an account number.

Amazon told KSLNewsradio that they take the security of their customers’ personal information seriously and only annotate “an extremely small sample of Alexa voice recordings in order [to] improve the customer experience.”

The statement continued: “Employees do not have direct access to information that can identify the person or account as part of this workflow. All information is treated with high confidentiality and we use multi-factor authentication to restrict access, service encryption and audits of our control environment to protect it.”

Amazon said that the employees are there to help train the speech recognition so that Alexa better understands your requests.

“We have strict technical and operational safeguards and have a zero tolerance policy for the abuse of our system,” the Amazon statement continued.

Echo devices use an on-device keyword spotting to detect a, “wake word,” and an Amazon spokesperson said that this is the default.

“Echo devices are designed to detect only your chosen wake word (Alexa, Amazon, Computer or Echo). The device detects the wake word by identifying acoustic patterns that match the wake word. No audio is stored or sent to the cloud unless the device detects the wake word (or Alexa is activated by pressing a button).” They continued.

You can tell if your device is streaming that information back to the cloud to get your answer when the light ring on the top of the Echo glows blue.


We want to hear from you.

Have a story idea or tip? Send it to the KSL NewsRadio team here.

Today’s Top Stories

All News

Utah lawmakers want to require dating apps to warn their users on dangers of online dating....
Peter Johnston

Swiping left on danger: combating dating app violence in Utah

A top researcher on sexual assault says many cases of dating app violence go unreported. Dr. Valentine calls dating apps "digital hunting grounds."
21 hours ago
West Valley Police received a call from family members of a suicidal individual leaving their home,...
Waverly Golden

Individual in custody after firing shots from his vehicle

West Valley Police received a call from family members of a suicidal individual leaving their home, the individual was safely taken into custody.
21 hours ago
A bill that could make its way to the Utah legislature in the 2023 session would require school dis...
Lindsay Aerts

New state flag referendum group ‘confident’ despite low signature numbers

SALT LAKE CITY — The group working to repeal Utah’s new state flag says they’re confident they’ll gather enough signatures to get the issue on the ballot, despite having turned in less than 1% of the required signatures as of Friday. As of midday, the group had 502 approved signatures. They need 134,298 by April […]
21 hours ago
the new utah state flag design is pictured...
Waverly Golden

Not everyone is a fan of Utah’s new state flag

A group is working to repeal Utah's new state flag, saying they already have 502 signatures approved towards getting the issue on the ballot. 
21 hours ago
On the latest KSL Greenhouse show, Taun and Maria gave tips on what you can do if you're seeing sno...
Michelle Lee

What you can do about snow mold in your lawn

SALT LAKE CITY – Snow is starting to melt in some areas, which means you might be seeing some snow mold on your lawn. Although there isn’t much you can do to prevent that from happening, Taun and Maria gave some tips on the latest KSL Greenhouse show. How can you tell if there’s snow […]
21 hours ago
buy-back guns...
Adam Small

Got unwanted guns? Salt Lake Police say bring them to buy-back event

For the second year in a row, the Salt Lake City Police Department will host a guns buy-back event at the Public Safety Building located at 475 South 300 East.
21 hours ago

Sponsored Articles

Cheerful young woman writing an assignment while sitting at desk between two classmates during clas...
BYU EMBA at the Marriott School of Business

Hear it Firsthand: 6 Students Share Their Executive MBA Experience at BYU’s Marriott School of Business

The Executive MBA program at BYU offers great opportunities. Hear experiences straight from students enrolled in the program.
Skier being towed by a rider on a horse. Skijoring....
Bear Lake Convention and Visitors Bureau

Looking for a new winter activity? Try skijoring in Bear Lake

Skijoring is when someone on skis is pulled by a horse, dog, animal, or motor vehicle. The driver leads the skiers through an obstacle course over jumps, hoops, and gates.
Banner with Cervical Cancer Awareness Realistic Ribbon...
Intermountain Health

Five common causes of Cervical Cancer – and what you can do to lower your risk

January is National Cervical Cancer Awareness month and cancer experts at Intermountain Health are working to educate women about cervical cancer.
Kid holding a cisco fish at winterfest...
Bear Lake Convention and Visitors Bureau

Get ready for fun at the 2023 Bear Lake Monster Winterfest

The Bear Lake Monster Winterfest is an annual weekend event jam-packed full of fun activities the whole family can enjoy.
happy friends with sparklers at christmas dinner...

15 easy Christmas dinner ideas

We’ve scoured the web for you and narrowed down a few of our favorite Christmas dinner ideas to make your planning easy.
Spicy Homemade Loaded Taters Tots...

5 Game Day Snacks for the Whole Family (with recipes!)

Try these game day snacks to make watching football at home with your family feel like a special occasion. 
Hey Alexa, are you listening to me?