Today at Tesla’s first Autonomy Day event, Elon Musk took questions from the press but didn’t have moment for questions about lidar. Historically, he’s been vocal about the technology, and this moment he put it as clear as he could.
“Lidar is a fool’s errand,” Elon Musk said. “Anyone relying on lidar is doomed. Doomed! [They are] high-price sensors that are unnecessary. It’s like having a whole bunch of high-price appendices. Like, one appendix is evil, well now you have a whole bunch of them, it’s ridiculous, you’ll see.”
The topic was brought up by a request about if Tesla’s just-revealed self-driving hardware could handle input from lidar. Tesla’s automobile’s currently uses several sources of data to acquire autonomous driving: radar, GPS, maps, ultrasonic sensors and more. But not lidar like some of Tesla’s majesty competitors. Elon Musk previously explained that he views lidar as a crutch for self-driving vehicles. For Tesla, cameras are the keys to the future and its CEO sees a future when cameras will enable Tesla to see through the most adverse weather situations.
Andrej Karparthy, Senior Director of AI, took the stage and explained that the world is built for visual recognition. Lidar systems, he said, have a solid moment deciphering between a plastic bag and a rubber tire. huge scale neural network training and visual recognition are necessary for stage 4 and stage 5 autonomy, he said.
“In that sense, lidar is really a shortcut,” Karparthy said. “It sidesteps the fundamental problems, the important problem of visual recognition, that is necessary for autonomy. It gives a false sense of progress, and is ultimately a crutch. It does give, like, really swift demos!”
Uber, Waymo, Cruise and several others use the technology in their self-driving technology stack. As proponents of the technology, they point to lidar’s ability to see through challenging weather and light conditions good than existing cameras. They’re high-price. And often hungry for energy. That’s where Tesla’s solution around cameras comes in.
The company today detailed its current epoch self-driving computer that works with all existing Tesla vehicles. Once the program is prepared, it will enable all Teslas to ride autonomously with their existing sensor set — at least that’s what the company says — and that sensor set doesn’t include lidar. Instead, the sensors inside Tesla vehicles lean on a neural network that’s trained by data collected by all Tesla vehicles.
“Everyone’s training the network all the moment,” Musk said. “Whether autopilot is on or off, the network is being trained. Every mile that’s driven for the automobile that’s hardware 2 or above is training the network.”
The resulting data is kind of scary, Musk mused later in the press conference. But presumably not as scary as relying on LIDAR.