Subscribe free to our newsletters via your
. 24/7 Space News .




ROBO SPACE
Rise of the Machines: video gamers beware
By Mariette LE ROUX
Paris (AFP) Feb 25, 2015


Researchers unveiled a software system Wednesday which had taught itself to play 49 different video games and proceeded to defeat human professionals -- a major step in the fast-developing Artificial Intelligence realm.

Not only did the system give flesh-and-blood gamers a run for their money, it discovered tricks its own programmers didn't even know existed, a team from Google-owned research company DeepMind reported in the scientific journal Nature.

"This... is the first time that anyone has built a single general learning system that can learn directly from experience to master a wide range of challenging tasks," said co-developer Demis Hassabis.

The feat brings us closer to a future run by smart, general-purpose robots which can teach themselves to perform a task, store a "memory" of trial and error and adapt their actions for a better outcome next time.

Such machines may be able to do anything from driving our cars to planning our holidays and conduct scientific research, said the team.

Inspired by the human learning process, the "artificial agent" dubbed deep Q-network (DQN) was let loose, with only minimal programming, on an Atari game console from the 1980s.

"The only information they (the system) get is the pixels (on the screen) and the game score and the goal they've been told is to maximise the score," Hassabis explains in a Nature video.

"Apart from that, they have no idea about what kind of game they are playing, what their controls do, what they're even controlling in the game."

Unlike humans, the algorithm-based software starts off without the benefit of previous experience.

Presented with an on-screen paddle and ball, for example, a human gamer would already know that the goal must somehow involve striking the one with the other.

The system, by comparison, learns by activating computer keys randomly until it starts scoring through trial and error.

- Learns, adapts, and gets better -

"The system kind of learns, adapts and gets better and better incrementally until eventually it becomes almost perfect on some of the games," said Hassabis.

Games included the late 1970's classic Breakout, in which the player has to break through several layers of bricks at the top of a computer screen with a "ball" bounced off a paddle sliding from side to side at the bottom, Ms Pac-Man which entails gobbling pellets along a maze, pinball, boxing, tennis and a car race called Enduro.

The system outperformed professional human players in many of the games, but fared poorly in some, including Ms Pac-Man.

In particular game types, explained DeepMind colleague Vlad Mnih, "it's very difficult to get your first points or first rewards, so if the game involves solving a maze then pressing keys randomly will not actually get you any points and then the system has nothing to learn from."

But it did discover aspects of games that its creators hadn't even known about. It figured out, for example, that in Breakout the optimal strategy is to dig a tunnel through one side of the wall and send the ball in to bounce behind it, breaking the bricks from the back.

- To the future and beyond -

The creators said their system was further advanced in many ways than Watson, an AI question-answering system that outwitted the most successful human players of quiz game Jeopardy in 2011, and Deep Blue, the computer which beat chess master Garry Kasparov in 1997.

Both these had largely been preprogrammed with their particular abilities.

"Whereas what we've done is build algorithms that learn from the ground up, so literally you give them perceptual experience and they learn how to do things directly from that perceptual experience," Hassabis told journalists.

"The advantage of these types of systems is that they can learn and adapt to unexpected things and also... the programmers or the system designers don't necessarily have to know the solution themselves in order for the machine to master that task."

The long-term goal, he added, was to build smart, general-purpose machines.

"We are many decades off from doing that," said the researcher. "But I do think that this is the first significant rung of the ladder that we're on."

The next developmental step will entail tests with 3D video games from the 90s.


Thanks for being here;
We need your help. The SpaceDaily news network continues to grow but revenues have never been harder to maintain.

With the rise of Ad Blockers, and Facebook - our traditional revenue sources via quality network advertising continues to decline. And unlike so many other news sites, we don't have a paywall - with those annoying usernames and passwords.

Our news coverage takes time and effort to publish 365 days a year.

If you find our news sites informative and useful then please consider becoming a regular supporter or for now make a one off contribution.
SpaceDaily Contributor
$5 Billed Once


credit card or paypal
SpaceDaily Monthly Supporter
$5 Billed Monthly


paypal only


.


Related Links
All about the robots on Earth and beyond!






Comment on this article via your Facebook, Yahoo, AOL, Hotmail login.

Share this article via these popular social media networks
del.icio.usdel.icio.us DiggDigg RedditReddit GoogleGoogle








ROBO SPACE
Japan's Robear: Strength of a robot, face of a bear
Tokyo (AFP) Feb 24, 2015
Forget the frightening androids of dystopian sci-fi, the future of robots is cute polar bears that can lift elderly people into and out of bed. The "Robear" has a cub-like face with big doey eyes, but packs enough power to transfer frail patients from a wheelchair to a bed or a bath, Japan's Riken institute said Tuesday. "The polar cub-like look is aimed at radiating an atmosphere of str ... read more


ROBO SPACE
Application of laser microprobe technology to Apollo samples refines lunar impact history

NASA releases video of the far side of the Moon

US Issuing Licenses for Mineral Mining on Moon

LRO finds lunar hydrogen more abundant on Moon's pole-facing slopes

ROBO SPACE
How Can We Protect Mars From Earth, While Searching For Life

The Search For Volcanic Eruptions On Mars Reaches The Next Level

Using Curiosity to Search for Life

Curiosity Self-Portrait at 'Mojave' Site on Mount Sharp

ROBO SPACE
Water pools in US astronaut's helmet after spacewalk

Korean tech start-ups offer life beyond Samsung

Fast visas and dim sum: Spain seeks to attract Chinese tourists

Industry: Risk aversion costs more than 'fast failure'

ROBO SPACE
Argentina welcomes first Chinese satellite tracking station outside China

More Astronauts for China

China launches the FY-2 08 meteorological satellite successfully

China's Long March puts satellite in orbit on 200th launch

ROBO SPACE
Russia to use International Space Station till 2024

NASA preparing to reassemble International Space Station

Spacewalking 'cable guys' wrap up work outside station

Space Station 3-D Printed Items, Seedlings Return in the Belly of a Dragon

ROBO SPACE
Next Launch of Heavy Angara-5 Rocket Due Next Year

SES Announces Two Launch Agreements With SpaceX

Soyuz Installed at Baikonur, Expected to Launch Wednesday

Leaders share messages, priorities at AFA Symposium

ROBO SPACE
Planets Can Alter Each Other's Climates over Eons

The mystery of cosmic oceans and dunes

Laser 'ruler' holds promise for hunting exoplanets

Scientists predict earth-like planets around most stars

ROBO SPACE
MUOS - a Vital Next Step for Narrowband Satellite Communications

Japan's NTT to buy German data centre operator: report

Moving molecule writes letters

New filter could advance terahertz data transmission




The content herein, unless otherwise known to be public domain, are Copyright 1995-2014 - Space Media Network. All websites are published in Australia and are solely subject to Australian law and governed by Fair Use principals for news reporting and research purposes. AFP, UPI and IANS news wire stories are copyright Agence France-Presse, United Press International and Indo-Asia News Service. ESA news reports are copyright European Space Agency. All NASA sourced material is public domain. Additional copyrights may apply in whole or part to other bona fide parties. Advertising does not imply endorsement, agreement or approval of any opinions, statements or information provided by Space Media Network on any Web page published or hosted by Space Media Network. Privacy Statement All images and articles appearing on Space Media Network have been edited or digitally altered in some way. Any requests to remove copyright material will be acted upon in a timely and appropriate manner. Any attempt to extort money from Space Media Network will be ignored and reported to Australian Law Enforcement Agencies as a potential case of financial fraud involving the use of a telephonic carriage device or postal service.