CNN

Most self-driving companies say this tech is crucial. Elon Musk disagrees.

Jun 18, 2019, 5:27 AM
self driving...
For most people building self-driving cars, lidar is viewed as a godsend. In recent years, enthusiasm for the technology has sparked shortages of the depth-measuring sensor, acquisitions of startups developing it and more than a billion dollars of investments.

(CNN) — For most people building self-driving cars, lidar is viewed as a godsend. In recent years, enthusiasm for the technology has sparked shortages of the depth-measuring sensor, acquisitions of startups developing it and more than a billion dollars of investments.

Tesla CEO Elon Musk says they’re all wasting their time.

“Lidar is a fool’s errand,” Musk said in April at a Tesla event. “Anyone relying on lidar is doomed. Doomed.”

Lidar, which stands for light detection and ranging, sends out pulses that bounce off objects and return to the sensor, telling it how far away things are.

Companies with the most experience developing self-driving cars — including Alphabet’s Waymo, Ford, and Amazon-backed Aurora — believe lidar is critical for safety. Lidar startups have raised $1.2 billion in the past five years, according to CB Insights which tracks venture capital. Lidar has other uses, such as making topographical maps, but most of the investing energy has surrounded autonomous driving.

Tesla is taking a different approach. The company’s bet — that artificial intelligence-powered cameras will become so good that lidar will be pointless has thrust lidar startups into the spotlight. Musk is so confident in his approach, he has taken to insulting lidar publicly.

“It seems like half the things Musk says are totally right, half are totally bonkers,” said Austin Russell, CEO of Luminar, a Silicon Valley lidar startup.

Louay Eldada, CEO of lidar startup Quanergy, said he received hundreds of questions from former colleagues and academics after Musk’s comments, asking if Musk knew something everyone else didn’t.

Some industry insiders agree with Musk, but only to a point. Starsky Robotics, a self-driving truck startup, spurns lidar, believing it isn’t needed. Starsky co-founder Kartik Tiwari recently wrote that lidar today lacks reliability, and has insufficient range for the distance a loaded tractor-trailer needs to see to stop on highways. Starsky admits lidar could help classify objects that camera and radar struggle with, but believes it’s easier to ask a human teleoperator to step in when a confusing object is seen.

Starsky is also focused on automating an easier self-driving challenge: highways. Starsky’s remote human drivers take over as trucks exit highways and enter more challenging roads, which have cross traffic, pedestrians and cyclists.

Eric Meyhofer, head of Uber’s advanced technology division, tells CNN Business he doesn’t expect lidar will be needed in five years, given how good cameras and radar will get. But for now Uber continues to use lidar for its self-driving cars.

“We’re going to develop lidar until we don’t need to,” Meyhofer said. “The problem is easier to solve with lidar. It lets us do things sooner.”

Lidar supporters view the technology as the third leg of a stool, a critical complement to the other sensors on a self-driving vehicle: cameras and radar. Some argue that if Tesla’s cars included lidar, high-profile deaths involving the company’s autopilot system might have been averted.

Experts in the industry and academia with no vested interest in lidar tell CNN Business that lidar may have been helpful in those crashes because the autonomous driving system would benefit from additional data that is coming from a sensor that excels at seeing objects that the Tesla sensors struggle with. They also caution that it’s still too early to know exactly what package of sensors will be needed for self-driving cars that drive better than humans.

“Do you need lidar? No, you don’t. But would that car operate safely, would it be able to operate in all conditions and certify itself, I believe no,” said Sanjay Sood, who leads autonomous driving at the mapping company Here. “You can build a car without an airbag or anti-lock brakes, but you probably wouldn’t want to.”

For cars to drive themselves, they’ll rely in the future on some combination of cameras, radar and lidar to understand their surroundings. Each type of sensor has its strengths and weaknesses. Cameras boast high-resolution, but they don’t work well in low light, and they struggle to determine depth, such as how close another vehicle is. Radar works well in bad weather, but has difficulty detecting fixed objects, like an emergency vehicle stopped on a road. Lidar’s strength is measuring the exact distance to an object, whether it is moving or stationary. But it struggles during bad weather: The lidar laser points will bounce off raindrops, snowflakes or dust, obscuring things that are more important for it to see, like cars and pedestrians.

“The more sensors you use, the better chance you have of getting it right,” said Eben Frankenberg, CEO of Echodyne, a Kirkland, Washington-based company developing radar. “If your radar says it sees a duck in the road and your camera says that’s a person with a walker, how do I break that tie?”

Tesla argues that using lidar sidesteps the problem of visual recognition and gives a false sense of progress.

“People drive with vision only, no lasers are involved. This seems to work quite well,” Tesla director of artificial intelligence Andrej Karpathy said at Tesla’s autonomy event. “Lidar points are a much less information-rich environment. Vision really understands the full details.”

The Autopilot system on Tesla’s vehicles today relies on cameras and radar. In some cases, the cars can steer themselves, keep up with the traffic and make lane changes to pass other vehicles.

But Tesla warns drivers that they must be ready to take over at any moment. Tesla’s other automated driving features are gradually rolling out, such as automated lane changing, which was released earlier this year. These partially autonomous features are called advanced driver-assistance systems, and they require the human driver to remain engaged.

Tesla plans to incrementally update the software until its cars are capable of full self-driving, a term that governing bodies haven’t standardized. Musk has promised a fleet of robo-taxis on roads next year, but he often misses his own deadlines.

A handful of deaths involving Tesla Autopilot point to the shortcomings that can accompany not using lidar, according to experts.

Two Tesla drivers died in separate but similar crashes on Florida roads in the last three years. Both drivers were killed when their Teslas crashed into tractor-trailers that were turning in front of them. A National Transportation Safety Board report on a 2016 crash found that the tractor-trailer was not detected before the crash. The agency’s preliminary report on a crash this March found that Autopilot did not execute evasive maneuvers and struck the truck at 68 mph.

Radar waves will bounce under a tractor-trailer, according to Frankenberg, the radar startup CEO, making the car think there’s a clear path ahead. Cameras can struggle to differentiate a white side of a truck from a bright sky overhead.

“The system would be better and have higher reliability if it included lidar,” said John Dolan, a professor at the Carnegie Mellon University Robotics Institute. “It’s definitely going to see a large truck or vehicle that’s crossing in front of you.”

A Daimler research paper on state-of-the-art radar concluded that radar isn’t sufficient for full self-driving, and developments are needed to comprehensively understand stationary objects. In March 2018, a man died using Autopilot when his Model X crashed into a concrete barrier on a California highway. An NTSB preliminary report on the crash found that the Tesla accelerated in the three seconds before the crash, and no precrash braking or evasive steering movement was detected.

Tesla declined to comment on the debate over lidar, and the suggestion it would make Autopilot safer.

“I like Elon, I like his spirit and I relate to his passion,” said Marta Hall, president of Velodyne, a lidar production company. “But I don’t like the irresponsible talk.”

The-CNN-Wire
™ & © 2019 Cable News Network, Inc., a Time Warner Company. All rights reserved.

Today’s Top Stories

CNN

First responders work the scene of a shooting at a Fourth of July parade on July 4, 2022, in Highla...
Amir Vera, Jason Hanna, Adrienne Broaddus and Helen Regan, CNN

Highland Park parade shooting suspect charged with 7 counts of murder, state’s attorney says

Officials in Illinois have filed seven counts of first-degree murder against the individual suspected of being involved in the Highland Park shooting Monday.
1 day ago
Police in Highland Park, Illinois, respond to a shooting at a Fourth of July event....
Eric Levenson, Adrienne Broaddus, Shawn Nottingham and Brynn Gingras, CNN. Mark Jackson

Police have arrested a ‘person of interest’ after a mass shooting at July 4th parade in Highland Park, Illinois

Robert E. Crimo III, a person of interest in a mass shooting at a parade that left six dead and sent more than two dozen people to hospitals, has been taken into custody near Lake Forest, Illinois, authorities said during a brief news conference.
2 days ago
People leave Field's shopping centre, after Danish police said they received reports of shooting, i...
Kim Norgaard, Pierre Meilhan and Jorge Engels, CNN

Several people killed in Copenhagen mall shooting, police say

shooting at a mall in Copenhagen has left several people dead, local police said Sunday.
3 days ago
Joseph Petito, father of Gabby Petito, speaks during a news conference on Tuesday, September 28, 20...
Jennifer Henderson, CNN

Florida judge allows lawsuit filed by Gabby Petito’s parents against Brian Laundrie’s parents to proceed

A lawsuit filed by Gabby Petito's parents will move forward, a Florida judge ruled Thursday. The lawsuit is against the parents of Brian Laundrie.
6 days ago
Immigration activists rally outside the US Supreme Court in Washington, DC on April 26. Photo credi...
Tierney Sneed and Priscilla Alvarez, CNN

Supreme Court says Biden can end Trump-era ‘Remain in Mexico’ immigration policy

The Supreme Court on Thursday gave President Joe Biden the green light to end the controversial "Remain in Mexico" immigration policy.
6 days ago
Justice Stephen Breyer and President Joe Biden....
Ariane de Vogue, CNN Supreme Court Reporter

Breyer makes it official: He’s leaving the Supreme Court on Thursday at noon

In a letter to President Joe Biden, Breyer said it had been his "great honor" to participate as a judge in the "effort to maintain our Constitution and the Rule of Law."
7 days ago

Sponsored Articles

Tax Harassment...
Jordan Wilcox

The best strategies for dealing with IRS tax harassment | You have options!

Learn how to deal with IRS tax harassment. This guide will teach you how to stop IRS phone calls and letters, and how to handle an IRS audit.
spend a day at Bear Lake...
Bear Lake Convention and Visitors Bureau

You’ll love spending the day at Bear Lake | How to spend a day at Bear Lake

Bear Lake is a place that needs to be experienced. Spend a day at Bear Lake.
Curb Appeal...
Price's Guaranteed Doors

How to have the best of both worlds for your house | Home security and curb appeal

Protect your home and improve its curb appeal with the latest security solutions like beautiful garage doors and increased security systems.
Prescription opioids can be disposed of during National Prescription Take Back Day...
Know Your Script

Prescription opioid misuse | How to protect your family from the opioid epidemic

Studies have shown that prescription opioid misuse has increased since COVID-19. So what do you need to know about these opioids?
national heart month...
Intermountain Healthcare

National Heart Month: 5 Lifestyle Changes to Make Today to Keep You Heart Healthy

Heart disease is the leading cause of death for both men and women. One person dies every 36 seconds in the United States from cardiovascular disease
Joseph Smith Memorial Building...
Temple Square

The Joseph Smith Memorial Building is an icon of Salt Lake City | Why hosting an event at this beautiful location will make you a hero this year

Here's why hosting an event at the iconic Joseph Smith Memorial Building in downtown Salt Lake City will make you a hero this year.
Most self-driving companies say this tech is crucial. Elon Musk disagrees.