. 24/7 Space News .
TECH SPACE
Teleoperating robots with virtual reality
by Staff Writers
Boston MA (SPX) Oct 05, 2017


VR system from Computer Science and Artificial Intelligence Laboratory could make it easier for factory workers to telecommute.

Many manufacturing jobs require a physical presence to operate machinery. But what if such jobs could be done remotely? This week researchers from MIT's Computer Science and Artificial Intelligence Laboratory (CSAIL) presented a virtual-reality (VR) system that lets you teleoperate a robot using an Oculus Rift headset.

The system embeds the user in a VR control room with multiple sensor displays, making it feel like they are inside the robot's head. By using gestures, users can match their movements to the robot's to complete various tasks.

"A system like this could eventually help humans supervise robots from a distance," says CSAIL postdoctoral associate Jeffrey Lipton, who was lead author on a related paper about the system. "By teleoperating robots from home, blue-collar workers would be able to tele-commute and benefit from the IT revolution just as white-collars workers do now."

The researchers even imagine that such a system could help employ increasing numbers of jobless video-gamers by "game-ifying" manufacturing positions.

The team demonstrated their VC control approach with the Baxter humanoid robot from Rethink Robotics, but said that the approach can work on other robot platforms and is also compatible with the HTC Vive headset.

Lipton co-wrote the paper with CSAIL director Daniela Rus and researcher Aidan Fay. They presented the paper this week at the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) in Vancouver.

How it works
There have traditionally been two main approaches to using VR for teleoperation.

In a "direct" model, the user's vision is directly coupled to the robot's state. With these systems, a delayed signal could lead to nausea and headaches, and the user's viewpoint is limited to one perspective.

In the "cyber-physical" model, the user is separate from the robot. The user interacts with a virtual copy of the robot and the environment. This requires much more data, and specialized spaces.

The CSAIL team's system is halfway between these two methods. It solves the delay problem, since the user is constantly receiving visual feedback from the virtual world. It also solves the the cyber-physical issue of being distinct from the robot: once a user puts on the headset and logs into the system, they will feel as if they are inside Baxter's head.

The system mimics the "homunculus model of mind" - the idea that there's a small human inside our brains controlling our actions, viewing the images we see and understanding them for us. While it's a peculiar idea for humans, for robots it fits: "inside" the robot is a human in a control room, seeing through its eyes and controlling its actions.

Using Oculus' controllers, users can interact with controls that appear in the virtual space to open and close the hand grippers to pick up, move, and retrieve items. A user can plan movements based on the distance between the arm's location marker and their hand while looking at the live display of the arm.

To make these movements possible, the human's space is mapped into the virtual space, and the virtual space is then mapped into the robot space to provide a sense of co-location.

The system is also more flexible compared to previous systems that require many resources. Other systems might extract 2-D information from each camera, build out a full 3-D model of the environment, and then process and redisplay the data.

In contrast, the CSAIL team's approach bypasses all of that by taking the 2-D images that are displayed to each eye. (The human brain does the rest by automatically inferring the 3-D information.)

To test the system, the team first teleoperated Baxter to do simple tasks like picking up screws or stapling wires. They then had the test users teleoperate the robot to pick up and stack blocks.

Users successfully completed the tasks at a much higher rate compared to the "direct" model. Unsurprisingly, users with gaming experience had much more ease with the system.

Tested against state-of-the-art systems, CSAIL's system was better at grasping objects 95 percent of the time and 57 percent faster at doing tasks. The team also showed that the system could pilot the robot from hundreds of miles away, testing it on a hotel's wireless network in Washington, DC to control Baxter at MIT.

"This contribution represents a major milestone in the effort to connect the user with the robot's space in an intuitive, natural, and effective manner." says Oussama Khatib, a computer science professor at Stanford University who was not involved in the paper.

The team eventually wants to focus on making the system more scalable, with many users and different types of robots that can be compatible with current automation technologies.

TECH SPACE
'Overwatch' eSports league to debut in December
San Francisco (AFP) Sept 20, 2017
Activision Blizzard announced Wednesday its "Overwatch" eSports league - cashing in on the rise of video gaming as a spectator sport - would make its debut in December. The computer game giant also announced three additional franchises in its freshly formed league, bringing the total to 12. The first of a series of exhibition matches was slated for December 6 at Blizzard Arena Los Ange ... read more

Related Links
Massachusetts Institute of Technology, CSAIL
Space Technology News - Applications and Research


Thanks for being there;
We need your help. The SpaceDaily news network continues to grow but revenues have never been harder to maintain.

With the rise of Ad Blockers, and Facebook - our traditional revenue sources via quality network advertising continues to decline. And unlike so many other news sites, we don't have a paywall - with those annoying usernames and passwords.

Our news coverage takes time and effort to publish 365 days a year.

If you find our news sites informative and useful then please consider becoming a regular supporter or for now make a one off contribution.
SpaceDaily Monthly Supporter
$5+ Billed Monthly


paypal only
SpaceDaily Contributor
$5 Billed Once


credit card or paypal


Comment using your Disqus, Facebook, Google or Twitter login.

Share this article via these popular social media networks
del.icio.usdel.icio.us DiggDigg RedditReddit GoogleGoogle

TECH SPACE
Space Cooperation Between China, Russia Needs Long-Term Mechanism

NASA's New Hubble E-Book Series Dives into the Solar System and Beyond

Mapping NASA's Space Missions

Aussie astronaut calls for establishment of national space agency

TECH SPACE
What looks good on paper may look good in space

Demonstrator 3 linear aerospike ready to start tests

ISRO to resume satellite launches by December

Mechanisms are Critical to Space Vehicle Flight Success

TECH SPACE
The Mars 2020 Rover features new spectral abilities with its new SuperCam

Devilish Source of Dust in Atmosphere of Earth and Mars

3-D Analysis Offers New Info on Martian Climate Change, Age of Polar Caps

HIAD heat shield material feels the burn during arc jet testing

TECH SPACE
Mars probe to carry 13 types of payload on 2020 mission

China's cargo spacecraft separates from Tiangong-2 space lab

Work on China's mission to Mars 'well underway'

Chinese company eyes development of reusable launch vehicle

TECH SPACE
The ESA 500: fostering start-up companies to use space technology on Earth

Thomas calls for new comprehensive Australian Space Agency at IAC address

AsiaSat 9 Set for Launch from Baikonur on September 29

Australia to create national space agency

TECH SPACE
UV-irradiated amorphous ice behaves like liquid at low temperatures

The 3-D selfie has arrived

Ultracold atoms point toward an intriguing magnetic behavior

Researchers developing new technique that uses light to separate mirrored molecules

TECH SPACE
Scientists propose new concept of terrestrial planet formation

The return of the comet-like exoplanet

New prediction of a detection wavelength for searching phototrophs on exoplanets

Hubble observes pitch black planet

TECH SPACE
Solving the Mystery of Pluto's Giant Blades of Ice

Global Aerospace Corporation to present Pluto lander concept to NASA

Pluto features given first official names

Hibernation Over, New Horizons Continues Kuiper Belt Cruise









The content herein, unless otherwise known to be public domain, are Copyright 1995-2024 - Space Media Network. All websites are published in Australia and are solely subject to Australian law and governed by Fair Use principals for news reporting and research purposes. AFP, UPI and IANS news wire stories are copyright Agence France-Presse, United Press International and Indo-Asia News Service. ESA news reports are copyright European Space Agency. All NASA sourced material is public domain. Additional copyrights may apply in whole or part to other bona fide parties. All articles labeled "by Staff Writers" include reports supplied to Space Media Network by industry news wires, PR agencies, corporate press officers and the like. Such articles are individually curated and edited by Space Media Network staff on the basis of the report's information value to our industry and professional readership. Advertising does not imply endorsement, agreement or approval of any opinions, statements or information provided by Space Media Network on any Web page published or hosted by Space Media Network. General Data Protection Regulation (GDPR) Statement Our advertisers use various cookies and the like to deliver the best ad banner available at one time. All network advertising suppliers have GDPR policies (Legitimate Interest) that conform with EU regulations for data collection. By using our websites you consent to cookie based advertising. If you do not agree with this then you must stop using the websites from May 25, 2018. Privacy Statement. Additional information can be found here at About Us.