Hey Alexa, are you listening to me?

Apr 11, 2019, 1:59 PM | Updated: Apr 12, 2019, 5:57 am

SALT LAKE CITY — Yes, Alexa is listening to you — and the smart speaker-turned-personal assistant isn’t the only one.

Amazon’s Alexa is one of the many now prevalent digital assistants meant to make your life easier and answer simple questions about your upcoming calendar appointments, or set timers and alarms, and even change the temperature or turn on your wi-fi connected smart home appliances.

Much of the ability of these digital assistants come from the vast computing power that Amazon has to run speech recognition software to change your voice into 1’s and 0’s that Alexa can understand. But to anyone who’s familiar with trying to ask the device a simple question knows, sometimes it’s incredibly frustrating.

“Somewhere along the way someone has to annotate that data that’s coming in,” Matt Day from Bloomberg News said.

Designated employees go in and see how much of what you said to the machine was heard correctly. They transcribe and annotate other snippets from conversations and questions to make sure that Alexa is understanding them properly, then feed that information back into the system. The goal: to keep teaching Alexa to be better at answering even the simplest questions, like what the weather is going to be like tomorrow.

“People are saying billions of things into Alexa [Amazon] says, and it’s going to pick up accidentally a ton of stuff including some disturbing things or some funny things,” Day said.

Day said those who work for Amazon across the globe have heard things like children crying, poor singing in the shower, and what, at times, may have been a sexual assault.

This process isn’t something that is unheard of, though. In the tech world, this form of processing is broadly known as ‘supervised learning’ when a human is involved, and when it is paired with other machine learning is known as ‘semi-supervised learning’.

There are thousands of these employees hired to listen and transcribe recordings captured by Amazon’s line of Echo speakers. Bloomberg reports those employees are transcribing up to 1,000 audio clips during their 9-hour shifts every day.

According to Bloomberg, several people that had reportedly worked for the internet giant said that the recordings are associated with the customer’s first name, device serial number, and an account number.

Amazon told KSLNewsradio that they take the security of their customers’ personal information seriously and only annotate “an extremely small sample of Alexa voice recordings in order [to] improve the customer experience.”

The statement continued: “Employees do not have direct access to information that can identify the person or account as part of this workflow. All information is treated with high confidentiality and we use multi-factor authentication to restrict access, service encryption and audits of our control environment to protect it.”

Amazon said that the employees are there to help train the speech recognition so that Alexa better understands your requests.

“We have strict technical and operational safeguards and have a zero tolerance policy for the abuse of our system,” the Amazon statement continued.

Echo devices use an on-device keyword spotting to detect a, “wake word,” and an Amazon spokesperson said that this is the default.

“Echo devices are designed to detect only your chosen wake word (Alexa, Amazon, Computer or Echo). The device detects the wake word by identifying acoustic patterns that match the wake word. No audio is stored or sent to the cloud unless the device detects the wake word (or Alexa is activated by pressing a button).” They continued.

You can tell if your device is streaming that information back to the cloud to get your answer when the light ring on the top of the Echo glows blue.


Today’s Top Stories


Doctoral student Suzi Creveling talks about her work on the Utah Bionic Leg in the new University o...
Mark Jones

University of Utah researchers unveil Utah Bionic Leg

The Utah Bionic Leg, unveiled Wednesday, was developed by researchers at the University of Utah,
3 days ago
Twitter might get bought by Elon Musk after all. Twitter screen shown on phone...

Musk offers to end legal fight, pay $44B to buy Twitter

The offer comes just two weeks before the Twitter lawsuit seeking to force Musk to go through with the deal goes to trial in Delaware Chancery Court.
4 days ago
IRS texts are bogus. Picture shows a sign saying "warning, scam alert" on a keyboard...
Mark Jackson

IRS warns taxpayers of ‘smishing’ scams involving IRS-themed texts

The IRS never texts asking for personal information, and it warns that messages claiming to be from the IRS are bogus and risky. Texting scams aim to get people's personal data.
4 days ago
Amazon email...
Samantha Murphy Kelly, CNN Business

Amazon is always watching

At an invite-only press event last week, Amazon unveiled a long list of product updates ahead of the holiday shopping season that appear designed to further insert its gadgets and services into every corner of our homes with the apparent goal of making everything a little easier.
6 days ago
Trucks are lined up for sale at Low Book Sales in Lindon on Thursday, Feb. 3, 2022. Most new vehicl...
Heather Kelly

Automatic emergency braking should only be used as a last resort

AAA of Utah says automatic emergency braking systems have limitations and should only be used as a last resort to prevent a crash.
9 days ago
Netflix gaming...
Catherine Thorbecke, CNN Business

Netflix to open its own video game studio as part of gaming pivot

The streaming giant is building its first in-house video game studio in Helsinki, Finland, as it expands its empire over mobile games.
10 days ago

Sponsored Articles

Young woman receiving laser treatment...
Form Derm Spa

How facial plastic surgery and skincare are joining forces

Facial plastic surgery is not only about looking good but about feeling good too. The medical team at Form Spa are trained to help you reach your aesthetic outcomes through surgery and through skincare and dermatology, too.
large group of friends tohether in a park having fun...
BYU MBA at the Marriott School of Business

What differentiates BYU’s MBA program from other MBA programs

Commitment to service is at the heart of BYU’s MBA program, which makes it stand out among other MBA programs across the country.
a worker with a drill in an orange helmet installs a door in the house...
Price's Guaranteed Doors

Home improvement tip: Increase the value of your home by weatherproofing doors

Make sure your home is comfortable before the winter! Seasonal maintenance keeps your home up to date. Read our tips on weatherproofing doors.
Curb Appeal...
Price's Guaranteed Doors

How to have the best of both worlds for your house | Home security and curb appeal

Protect your home and improve its curb appeal with the latest security solutions like beautiful garage doors and increased security systems.
A paper reading IRS, internal revenue service is pictured...
Jordan Wilcox

The best strategies for dealing with IRS tax harassment | You have options!

Learn how to deal with IRS tax harassment. This guide will teach you how to stop IRS phone calls and letters, and how to handle an IRS audit.
spend a day at Bear Lake...
Bear Lake Convention and Visitors Bureau

You’ll love spending the day at Bear Lake | How to spend a day at Bear Lake

Bear Lake is a place that needs to be experienced. Spend a day at Bear Lake.
Hey Alexa, are you listening to me?