Speed around a French village in the video game Gran Turismo and you might spot a Corvette behind you trying to catch your slipstream.

The technique of using the to speed up and overtake them is one favored by skilled players of PlayStationB次元官网网址檚 realistic racing game.

But this Corvette driver is not being controlled by a human B次元官网网址� itB次元官网网址檚 GT Sophy, a powerful artificial intelligence agent built by PlayStation-maker Sony.

Gran Turismo players have been competing against computer-generated racecars since the franchise launched in the 1990s, but the new AI driver that was unleashed last week on Gran Turismo 7 is smarter and faster because itB次元官网网址檚 been trained using the latest AI methods.

B次元官网网址淕ran Turismo had a built-in AI existing from the beginning of the game, but it has a very narrow band of performance and it isnB次元官网网址檛 very good,B次元官网网址� said Michael Spranger, chief operating officer of Sony AI. B次元官网网址淚tB次元官网网址檚 very predictable. Once you get past a certain level, it doesnB次元官网网址檛 really entice you anymore.B次元官网网址�

But now, he said, B次元官网网址渢his AI is going to put up a fight.B次元官网网址�

Visit an at universities and companies like Sony, Google, Meta, Microsoft and and itB次元官网网址檚 not unusual to find AI agents like Sophy racing cars, slinging angry birds at pigs, fighting epic interstellar battles or helping human gamers build new Minecraft worlds B次元官网网址� all part of the job description for computer systems trying to learn how to get smarter in games.

But in some instances, they are also trying to learn how to get smarter in the real world. In a January paper, a University of Cambridge researcher who built an AI agent to control Pok茅mon characters argued it could B次元官网网址渋nspire all sorts of applications that require team management under conditions of extreme uncertainty, including managing a team of doctors, robots or employees in an ever-changing environment, like a pandemic-stricken region or a war zone.B次元官网网址�

And while that might sound like a kid making a case for playing three more hours of , the study of games has been used to advance AI research B次元官网网址� and train computers to solve complex problems B次元官网网址� since the mid-20th century.

Initially, AI was used on games like checkers and chess to test at winning strategy games. Now a new branch of research is more focused on performing open-ended tasks in complex worlds and interacting with humans, not just for the purpose of beating them.

B次元官网网址淩eality is like a super-complicated game,B次元官网网址� said Nicholas Sarantinos, who authored the Pok茅mon paper and recently turned down a doctoral offer at Oxford University to start an AI company aiming to help corporate workplaces set up more collaborative teams.

In the web-based Pok茅mon Showdown battle simulator, Sarantinos developed an algorithm to analyze a team of six Pok茅mon B次元官网网址� predicting how they would perform based on all the possible battle scenarios ahead of them and their comparative strengths and weaknesses.

Microsoft, which owns the popular Minecraft game franchise as well as the Xbox game system, has tasked AI agents with a variety of activities B次元官网网址� from steering clear of lava to chopping trees and making furnaces. Researchers hope some of their learnings could eventually play a role in real-world technology, such as how to get a home robot to take on certain chores without having to program it to do so.

While it B次元官网网址漡oes without statingB次元官网网址� that real humans behave quite differently from fictional video game creatures, B次元官网网址渢he core ideas can still be used,B次元官网网址� Sarantinos said. B次元官网网址淚f you use psychology tests, you can take this information to conclude how well they can work together.B次元官网网址�

Amy Hoover, an assistant professor of informatics at the New Jersey Institute of Technology whoB次元官网网址檚 built algorithms for the digital card game Hearthstone, said B次元官网网址渢here really is a reason for studying gamesB次元官网网址� but it is not always easy to explain.

B次元官网网址淧eople arenB次元官网网址檛 always understanding that the point is about the optimization method rather than the game,B次元官网网址� she said.

Games also offer a useful testbed for AI B次元官网网址� including for some real-world applications in robotics or health care B次元官网网址� thatB次元官网网址檚 safer to try in a virtual world, said Vanessa Volz, a researcher and co-founder of the Danish startup Modl.ai, which builds AI systems for game development.

But, she adds, B次元官网网址渋t can get overhyped.B次元官网网址�

B次元官网网址淚tB次元官网网址檚 probably not going to be one big breakthrough and that everything is going to be shifted to the real world,B次元官网网址� Volz said.

Japanese electronics giant Sony launched its own AI research division in 2020 with entertainment in mind, but itB次元官网网址檚 nonetheless attracted broader academic attention. introducing Sophy last year made it on the cover of the prestigious science journal Nature, which said it could potentially have effects on other applications such as drones and .

The technology behind Sophy is based on an algorithmic method known as reinforcement learning, which trains the system by rewarding it when it gets something right as it runs virtual races thousands of times.

B次元官网网址淭he reward is going to tell you that, B次元官网网址榊ouB次元官网网址檙e making progress. This is good,B次元官网网址� or, B次元官网网址榊ouB次元官网网址檙e off the track. Well, thatB次元官网网址檚 not good,B次元官网网址橞次元官网网址� Spranger said.

The worldB次元官网网址檚 best Gran Turismo players are still finishing ahead of Sophy at tournaments, but average players will find it hard to beat B次元官网网址� and can adjust difficulty settings depending on how much they want to be challenged.

PlayStation players will only get to try racing against Sophy until March 31, on a limited number of circuits, so it can get some feedback and go back into testing. Peter Wurman, director of Sony AI America and project lead on GT Sophy, said it takes about two weeks for AI agents to train on 20 PlayStations.

B次元官网网址淭o get it spread throughout the whole game, it takes some more breakthroughs and some more time before weB次元官网网址檙e ready for that,B次元官网网址� he said.

And to get it onto real streets or Formula One tracks? That could take a lot longer.

adopt similar machine-learning techniques, but B次元官网网址渢hey donB次元官网网址檛 hand over complete control of the car the way we are able to,B次元官网网址� Wurman said. B次元官网网址淚n a simulated world, thereB次元官网网址檚 nobodyB次元官网网址檚 life at risk. You know exactly the kinds of things youB次元官网网址檙e going to see in the environment. ThereB次元官网网址檚 no people crossing the road or anything like that.B次元官网网址�

B次元官网网址擬att OB次元官网网址檅rien, The Associated Press