Don't Worry, Driverless Cars Are Learning From Grand Theft Auto
Companies from Ford Motor Co. to Alphabet Inc.s Waymo may boast about putting no-hands models on the market in three years
Follow us on
Highlights
- The video game is one of the simulation platforms used by researchers
- The game is the richest virtual environment to extract data from
- Manufacturers are working on bringing autonomous cars by 2020
In the race to the autonomous revolution, developers have realized there aren’t enough hours in a day to clock the real-world miles needed to teach cars how to drive themselves. Which is why Grand Theft Auto V is in the mix.
The blockbuster video game is one of the simulation platforms researchers and engineers increasingly rely on to test and train the machines being primed to take control of the family sedan. Companies from Ford Motor Co. to Alphabet Inc.’s Waymo may boast about putting no-hands models on the market in three years, but there’s a lot still to learn about drilling algorithms in how to respond when, say, a mattress falls off a truck on the freeway.
If automakers and tech enterprises want to make their deadline, they have to hurry up. The test cars tricked out with lasers, sensors and cameras being put through the paces on tracks and public roads can’t do it on their own. Simulators never run out of gas -- and the ones at Waymo can model driving more than 3 million miles in a single day.
“Just relying on data from the roads is not practical,” said Davide Bacchet, who leads the simulation effort in San Jose, California, for Nio, a startup aiming to introduce an autonomous electric car in the U.S. in 2020. “With simulation, you can run the same scenario over and over again for infinite times, then test it again.”
As improbable as it may seem to the lay person, hyper-realistic video games are able to generate data that’s very close to what artificial-intelligence agents can glean on the road. AI software has been playing around with games from Super Mario Bros. to Angry Birds for a while now, tackling problems in controlled environments and learning through trial and error.
Last year, scientists from Darmstadt University of Technology in Germany and Intel Labs developed a way to pull visual information from Grand Theft Auto V. Now some researchers are deriving algorithms from GTAV software that’s been tweaked for use in the burgeoning self-driving sector.
The latest in the franchise from publisher Rockstar Games Inc. is just about as good as reality, with 262 types of vehicles, more than 1,000 different unpredictable pedestrians and animals, 14 weather conditions and countless bridges, traffic signals, tunnels and intersections. (The hoodlums, heists and accumulated corpses aren’t crucial components.)
The idea isn’t that the highways and byways of the fictional city of Los Santos would ever be a substitute for bona fide asphalt. But the game “is the richest virtual environment that we could extract data from,” said Alain Kornhauser, a Princeton University professor of operations research and financial engineering who advises the Princeton Autonomous Vehicle Engineering team.
Waymo uses its simulators to create a confounding motoring situation for every variation engineers can think of: having three cars changing lanes at the same time at an assortment of speeds and directions, for instance. What’s learned virtually is applied physically, and problems encountered on the road are studied in simulation.
Whenever a human has to grab the wheel of a test car because self-driving software hasn’t responded properly, “we’re able to play back the exact situation and predict via simulation what could have happened if the car had been left to drive itself,” Waymo said in a self-driving project report. “If the simulator shows better driving is called for, our engineers can make refinements to the software, and run those changes in simulation in order to test the fixes.”
At Toyota Motor Corp.’s Toyota Research Institute in California, engineers try to “break the system” through what’s known as the Quick Brown Fox test: running mile after mile in the most challenging weather and traffic conditions.
For all the stupid mistakes motorists regularly make, the human brain is far superior to a computer in perceiving and reacting to the unexpected, from a pothole to a construction zone to a toddler chasing a ball into the street. That’s the great challenge for all the companies competing to be first in the autonomous space: how to make on-board systems better than people at driving, and make driving safer.
A looming question is what state and federal safety regulators will demand as proof an autonomous car should be given license to roam. Hundreds of billions of miles may have to be racked up, one way or another. The authorities will probably accept a combination of real and replicated, but rules spelling out requirements have yet to be written.
Gill Pratt, chief executive officer of the Toyota institute, told a House Energy and Commerce subcommittee in February that simulation should “be an acceptable equivalent to real-word testing,” with follow-up validation. That’s the road developers are increasingly traveling.
The blockbuster video game is one of the simulation platforms researchers and engineers increasingly rely on to test and train the machines being primed to take control of the family sedan. Companies from Ford Motor Co. to Alphabet Inc.’s Waymo may boast about putting no-hands models on the market in three years, but there’s a lot still to learn about drilling algorithms in how to respond when, say, a mattress falls off a truck on the freeway.
If automakers and tech enterprises want to make their deadline, they have to hurry up. The test cars tricked out with lasers, sensors and cameras being put through the paces on tracks and public roads can’t do it on their own. Simulators never run out of gas -- and the ones at Waymo can model driving more than 3 million miles in a single day.
“Just relying on data from the roads is not practical,” said Davide Bacchet, who leads the simulation effort in San Jose, California, for Nio, a startup aiming to introduce an autonomous electric car in the U.S. in 2020. “With simulation, you can run the same scenario over and over again for infinite times, then test it again.”
As improbable as it may seem to the lay person, hyper-realistic video games are able to generate data that’s very close to what artificial-intelligence agents can glean on the road. AI software has been playing around with games from Super Mario Bros. to Angry Birds for a while now, tackling problems in controlled environments and learning through trial and error.
Last year, scientists from Darmstadt University of Technology in Germany and Intel Labs developed a way to pull visual information from Grand Theft Auto V. Now some researchers are deriving algorithms from GTAV software that’s been tweaked for use in the burgeoning self-driving sector.
The latest in the franchise from publisher Rockstar Games Inc. is just about as good as reality, with 262 types of vehicles, more than 1,000 different unpredictable pedestrians and animals, 14 weather conditions and countless bridges, traffic signals, tunnels and intersections. (The hoodlums, heists and accumulated corpses aren’t crucial components.)
The idea isn’t that the highways and byways of the fictional city of Los Santos would ever be a substitute for bona fide asphalt. But the game “is the richest virtual environment that we could extract data from,” said Alain Kornhauser, a Princeton University professor of operations research and financial engineering who advises the Princeton Autonomous Vehicle Engineering team.
Waymo uses its simulators to create a confounding motoring situation for every variation engineers can think of: having three cars changing lanes at the same time at an assortment of speeds and directions, for instance. What’s learned virtually is applied physically, and problems encountered on the road are studied in simulation.
Whenever a human has to grab the wheel of a test car because self-driving software hasn’t responded properly, “we’re able to play back the exact situation and predict via simulation what could have happened if the car had been left to drive itself,” Waymo said in a self-driving project report. “If the simulator shows better driving is called for, our engineers can make refinements to the software, and run those changes in simulation in order to test the fixes.”
At Toyota Motor Corp.’s Toyota Research Institute in California, engineers try to “break the system” through what’s known as the Quick Brown Fox test: running mile after mile in the most challenging weather and traffic conditions.
For all the stupid mistakes motorists regularly make, the human brain is far superior to a computer in perceiving and reacting to the unexpected, from a pothole to a construction zone to a toddler chasing a ball into the street. That’s the great challenge for all the companies competing to be first in the autonomous space: how to make on-board systems better than people at driving, and make driving safer.
A looming question is what state and federal safety regulators will demand as proof an autonomous car should be given license to roam. Hundreds of billions of miles may have to be racked up, one way or another. The authorities will probably accept a combination of real and replicated, but rules spelling out requirements have yet to be written.
Gill Pratt, chief executive officer of the Toyota institute, told a House Energy and Commerce subcommittee in February that simulation should “be an acceptable equivalent to real-word testing,” with follow-up validation. That’s the road developers are increasingly traveling.
(This story has not been edited by NDTV staff and is auto-generated from a syndicated feed.)
Stay updated with automotive news and reviews right at your fingertips through carandbike.com's WhatsApp Channel.
Great Deals on Used Cars
View All Used Cars
2017 Toyota Fortuner
- 1,18,054 km
- Diesel
- Automatic
₹ 24.50 L
Max Motors Yozna Vihar, New Delhi
2014 BMW X1
- 44,300 km
- Diesel
- Automatic
₹ 10.90 L
Max Motors Yozna Vihar, New Delhi
2012 Honda City
- 84,000 km
- Petrol
- Automatic
₹ 4.20 L
Max Motors Yozna Vihar, New Delhi
2013 Audi A6
- 77,000 km
- Diesel
- Automatic
₹ 8.25 L
Max Motors Yozna Vihar, New Delhi
2014 Audi A3
- 47,549 km
- Diesel
- Automatic
₹ 12.50 L
Max Motors Yozna Vihar, New Delhi
2016 Volvo V40
- 76,000 km
- Diesel
- Automatic
₹ 12.50 L
Guru Kripa Motors Prashant Vihar, New Delhi
2013 Mitsubishi Pajero Sport
- 76,000 km
- Diesel
- Manual
₹ 8.50 L
Guru Kripa Motors Prashant Vihar, New Delhi
2015 Mitsubishi Pajero Sport
- 62,500 km
- Diesel
- Automatic
₹ 11.90 L
Guru Kripa Motors Prashant Vihar, New Delhi
2009 Skoda Fabia
- 81,000 km
- Petrol
- Manual
₹ 1.95 L
Guru Kripa Motors Prashant Vihar, New Delhi
2013 Ford EcoSport
- 85,000 km
- Diesel
- Manual
₹ 3.75 L
Guru Kripa Motors Prashant Vihar, New Delhi
Upcoming Cars
Upcoming Bikes
Explore More
Two-Wheeler Sales November 2023: Ola Electric Bags Highest-Ever Monthly Sales With 30,000 Registrations
10 hours ago
A strong push during the festive season helped Ola Electric achieve its highest-ever monthly sales, retaining its number-one position in the market.
Actor Gauhar Khan Brings Home A Mercedes-Benz GLE 300d SUV
11 hours ago
Gauhar Khan and her husband, Zaid Darbar, were pictured together at the dealership in Mumbai while taking delivery of their new Mercedes.
Two-Wheeler Sales November 2023: Hero MotoCorp Reports 25% Domestic Sales Growth
11 hours ago
Hero MotoCorp’s cumulative sales for November 2023 stood at 491,050 units, witnessing a 25.61 per cent increase year-on-year
Auto Sales November 2023: Tata Motors Reports Marginal Dip in Sales
11 hours ago
Two-Wheeler Sales November 2023: Royal Enfield Sells 80,251 Units; Registers 13% YoY Growth
11 hours ago
The bikemaker’s cumulative motorcycle sales for the year 2023 stood at 621,672 units, reflecting a 13 per cent increase.
Auto Sales November 2023: Honda Cars India Reports Domestic Sales Of 8,730 Units
12 hours ago
In the previous month, the automaker sold a total of 11,891 units, marking a growth of 24 per cent as compared to the same month last year.
Maruti Suzuki Yet To Deliver Close To 50,000 Units Of Ertiga CNG
13 hours ago
At present, India’s largest carmaker holds just a little over 2.06 lakh open bookings, nearly a third of which are for the Ertiga.
2024 Bajaj Chetak Urbane E-Scooter Launched; Priced At Rs 1.15 Lakh
14 hours ago
New variant of the Chetak scooter gets some changes as compared to the Premium variant currently on sale.
Auto Sales November 2023: Toyota Kirloskar Motor Reports 51 Per Cent Growth
15 hours ago
The cumulative sales for the Calendar Year 2023 reached 2,10,497 units - a 40 per cent growth over 2022
Two-Wheeler Sales November 2023: Ather Energy Sells 9,344 Units; Reports 22.5 Per Cent Growth
16 hours ago
While sales were up in comparison to November 2022, Ather reported a 7 per cent decline in sales as compared to October 2023
