Nvidia Car Learns To Drive By Watching Humans - InformationWeek

InformationWeek is part of the Informa Tech Division of Informa PLC

This site is operated by a business or businesses owned by Informa PLC and all copyright resides with them.Informa PLC's registered office is 5 Howick Place, London SW1P 1WG. Registered in England and Wales. Number 8860726.

Mobile // Mobile Devices
09:06 AM
Connect Directly

Nvidia Car Learns To Drive By Watching Humans

With a convolutional neural network, Nvidia researchers have trained a car to drive using video captured during road trips taken by people.

Data Products: 9 Best Practices To Minimize Risk
Data Products: 9 Best Practices To Minimize Risk
(Click image for larger view and slideshow.)

Nvidia researchers have created a convolutional neural network which has learned the rules of the road by observing video from cars operated by human drivers.

The achievement demonstrates one reason there's so much excitement about artificial intelligence in the tech industry at the moment: When AI systems can learn, they require less programming.

Danny Shapiro, Nvidia's senior director of automotive, said in a blog post that the company wanted to create a robust system for driving on public roads without the need to write code to handle every specific condition a driver might encounter, a requirement he considers impractical.

Nvidia's nine-month-old project, dubbed DAVE2, represents an effort to expand on DARPA Autonomous Vehicle (DAVE) research, which aimed to create a system that could navigate public roads. DAVE ran from September 2003 through June 2004. Its success, given the standards of the time, led to further advancements in robotic navigation.

Using an Nvidia DevBox (a workstation with GPUs optimized for machine learning), Torch 7 (a machine-learning library), and an Nvidia DRIVE PX self-driving car computer, company researchers mapped the pixels of videos from a car's front-facing camera to steering commands.

"With minimum training data from humans, the system learns to drive in traffic on local roads with or without lane markings and on highways," Nvidia researchers explained in a paper describing the project. "It also operates in areas with unclear visual guidance, such as in parking lots and on unpaved roads."

The Nvidia team presented DAVE2 with about 72 hours of training data captured while a human driver traversed a variety of roads, mainly in New Jersey, but also in Illinois, Michigan, New York, and Pennsylvania, during a range of weather and lighting conditions.

(Image: Nvidia)

(Image: Nvidia)

After testing DAVE2 in a simulator, the team took it for a spin on public roads.

The original DAVE was a poor driver by today's standards. According to Nvidia's researchers, it could typically travel about 20 meters in complex environments before crashing. DAVE2 does a lot better.

"For a typical drive in Monmouth County, N.J., from our office in Holmdel to Atlantic Highlands, we are autonomous approximately 98% of the time," the researchers said. "We also drove 10 miles on the Garden State Parkway (a multi-lane divided highway with on- and off-ramps) with zero intercepts."

Advancements in deep learning have also taught Nvidia to see itself in a different light. The unexpected utility of GPU-powered number crunching for AI applications has helped Nvidia look beyond graphics and gaming applications toward a more central role in the computing industry.

As Yann LeCun, director of AI research for Facebook, put it last year, "It's amazing to me that so many leading companies, such as Nvidia, are changing their strategy because of deep learning and convolutional [neural] nets!"

Earlier this year, Jen-Hsun Huang, co-founder and CEO of Nvidia, described deep learning as  "a fundamentally new software model" and said his company is "betting that GPU-accelerated computing is the horse to ride."

Better still, it could be the self-driving car to ride.

Thomas Claburn has been writing about business and technology since 1996, for publications such as New Architect, PC Computing, InformationWeek, Salon, Wired, and Ziff Davis Smart Business. Before that, he worked in film and television, having earned a not particularly useful ... View Full Bio

We welcome your comments on this topic on our social media channels, or [contact us directly] with questions about the site.
Comment  | 
Print  | 
More Insights
Newest First  |  Oldest First  |  Threaded View
User Rank: Ninja
5/13/2016 | 9:57:10 AM
Re: Um, no.
And New Jersey drivers are not the best around, either
User Rank: Ninja
5/11/2016 | 12:47:30 PM
I wonder how AI handles flipping the middle finger when someone cuts you off or something else exceedingly stupid? Maybe it just uploads a virus into the offending car?
User Rank: Ninja
5/11/2016 | 9:44:44 AM
Um, no.
This isn't all that good of an idea. In studies, it's been shown that people don't drive are correctly as they think they do, and that includes professional drivers. So what this may be doing is enshrining improper ways to respond to situations, just because that's the way people do it. And then there is the fact that about 95% of accidents are caused by human error of one kind or another.
Why 2021 May Turn Out to be a Great Year for Tech Startups
John Edwards, Technology Journalist & Author,  2/24/2021
How GIS Data Can Help Fix Vaccine Distribution
Jessica Davis, Senior Editor, Enterprise Apps,  2/17/2021
11 Ways DevOps Is Evolving
Lisa Morgan, Freelance Writer,  2/18/2021
White Papers
Register for InformationWeek Newsletters
Current Issue
2021 Top Enterprise IT Trends
We've identified the key trends that are poised to impact the IT landscape in 2021. Find out why they're important and how they will affect you.
Flash Poll