. 24/7 Space News .
TECH SPACE
Software enables robots to be controlled in virtual reality
by Staff Writers
Providence RI (SPX) Dec 18, 2017


Brown University undergraduate Eric Rosen operates a Baxter robot using a virtual reality interface developed in Brown's Humans to Robots lab.

Even as autonomous robots get better at doing things on their own, there will still be plenty of circumstances where humans might need to step in and take control. New software developed by Brown University computer scientists enables users to control robots remotely using virtual reality, which helps users to become immersed in a robot's surroundings despite being miles away physically.

The software connects a robot's arms and grippers as well as its onboard cameras and sensors to off-the-shelf virtual reality hardware via the internet. Using handheld controllers, users can control the position of the robot's arms to perform intricate manipulation tasks just by moving their own arms.

Users can step into the robot's metal skin and get a first-person view of the environment, or can walk around the robot to survey the scene in the third person - whichever is easier for accomplishing the task at hand. The data transferred between the robot and the virtual reality unit is compact enough to be sent over the internet with minimal lag, making it possible for users to guide robots from great distances.

"We think this could be useful in any situation where we need some deft manipulation to be done, but where people shouldn't be," said David Whitney, a graduate student at Brown who co-led the development of the system.

"Three examples we were thinking of specifically were in defusing bombs, working inside a damaged nuclear facility or operating the robotic arm on the International Space Station."

Whitney co-led the work with Eric Rosen, an undergraduate student at Brown. Both work in Brown's Humans to Robots lab, which is led by Stefanie Tellex, an assistant professor of computer science. A paper describing the system and evaluating its usability was presented this week at the International Symposium on Robotics Research in Chile.

Even highly sophisticated robots are often remotely controlled using some fairly unsophisticated means - often a keyboard or something like a video game controller and a two-dimensional monitor. That works fine, Whitney and Rosen say, for tasks like driving a wheeled robot around or flying a drone, but can be problematic for more complex tasks.

"For things like operating a robotic arm with lots of degrees of freedom, keyboards and game controllers just aren't very intuitive," Whitney said. And mapping a three-dimensional environment onto a two-dimensional screen could limit one's perception of the space the robot inhabits.

Whitney and Rosen thought virtual reality might offer a more intuitive and immersive option. Their software links together a Baxter research robot with an HTC Vive, a virtual reality system that comes with hand controllers. The software uses the robot's sensors to create a point-cloud model of the robot itself and its surroundings, which is transmitted to a remote computer connected to the Vive. Users can see that space in the headset and virtually walk around inside it. At the same time, users see live high-definition video from the robot's wrist cameras for detailed views of manipulation tasks to be performed.

For their study, the researchers showed that they could create an immersive experience for users while keeping the data load small enough that it could be carried over the internet without a distracting lag. A user in Providence, R.I., for example, was able to perform a manipulation task - the stacking of plastic cups one inside the others - using a robot 41 miles away in Cambridge, Mass.

In additional studies, 18 novice users were able to complete the cup-stacking task 66 percent faster in virtual reality compared with a traditional keyboard-and-monitor interface. Users also reported enjoying the virtual interface more, and they found the manipulation tasks to be less demanding compared with keyboard and monitor.

Rosen thinks the increased speed in performing the task was due to the intuitiveness of the virtual reality interface.

"In VR, people can just move the robot like they move their bodies, and so they can do it without thinking about it," Rosen said.

"That lets people focus on the problem or task at hand without the increased cognitive load of trying to figure out how to move the robot."

The researchers plan to continue developing the system. The first iteration focused on a fairly simple manipulation task with a robot that was stationary in the environment. They'd like to try more complex tasks and later combine manipulation with navigation. They'd also like to experiment with mixed autonomy, where the robot does some tasks on its own and the user takes over for other tasks.

The researchers have made the system freely available on the web. They hope other robotics researchers might give it a try and take it in new directions of their own.

Research paper

TECH SPACE
Virtual reality makes journalism immersive, realism makes it credible
University Park PA (SPX) Dec 11, 2017
Virtual reality technology may help journalists pull an audience into their stories, but they should avoid being too flashy, or their credibility could suffer, according to a team of researchers. In a study, participants indicated that stories experienced in virtual reality - VR - significantly outperformed text-based articles in several categories, such as giving them a sense of presence, ... read more

Related Links
Brown University
Space Technology News - Applications and Research


Thanks for being there;
We need your help. The SpaceDaily news network continues to grow but revenues have never been harder to maintain.

With the rise of Ad Blockers, and Facebook - our traditional revenue sources via quality network advertising continues to decline. And unlike so many other news sites, we don't have a paywall - with those annoying usernames and passwords.

Our news coverage takes time and effort to publish 365 days a year.

If you find our news sites informative and useful then please consider becoming a regular supporter or for now make a one off contribution.
SpaceDaily Monthly Supporter
$5+ Billed Monthly


paypal only
SpaceDaily Contributor
$5 Billed Once


credit card or paypal


Comment using your Disqus, Facebook, Google or Twitter login.

Share this article via these popular social media networks
del.icio.usdel.icio.us DiggDigg RedditReddit GoogleGoogle

TECH SPACE
Tech titans ramp up tools to win over children

Spaceships and Politics: Sputnik Talks to Cosmonaut Sergei Krikalev

Aerospace and Mitchell Institute release new report on policy needs for space operations

UAE launches programme to send astronauts into space

TECH SPACE
Nozzle Assemblies Complete for Exploration Mission-1 Solid Rocket Boosters

Rocket Lab to launch rocket from New Zealand

SpaceX's Elon Musk to launch his own car into deep space

ISRO eyes one rocket launch a month in 2018

TECH SPACE
Space program should focus on Mars, says editor of New Space

EU exempts fuel for ExoMars mission from Russian sanctions

NASA's oldest Mars rover survives another harsh winter

Mars Rover Team's Tilted Winter Strategy Works

TECH SPACE
Nation 'leads world' in remote sensing technology

China plans for nuclear-powered interplanetary capacity by 2040

China plans first sea based launch by 2018

China's reusable spacecraft to be launched in 2020

TECH SPACE
mu Space becomes first Thai startup to acquire satellite license

Regulation and compliance for nontraditional space missions

Orbital ATK purchase by Northrop Grumman approved by shareholders

UK space launch program receives funding boost from Westminster

TECH SPACE
Better mastery of heat flow leads to next-generation thermal cloaks

Blackbody radiation from a warm object attracts polarizable objects

Nature's toughest substances decoded

Penn researchers establish universal signature fundamental to how glassy materials fail

TECH SPACE
Two Super-Earths around red dwarf K2-18

U of T researcher finds Earth-like conditions in little-known exoplanet - and discovers a new planet

A New Spin to Solving Mystery of Stellar Companions

The CHEOPS scientific instrument is complete

TECH SPACE
New Horizons Corrects Its Course in the Kuiper Belt

Wrapping up 2017 one year out from MU69

Jupiter Blues

Research bolsters possibility of plate tectonics on Europa









The content herein, unless otherwise known to be public domain, are Copyright 1995-2024 - Space Media Network. All websites are published in Australia and are solely subject to Australian law and governed by Fair Use principals for news reporting and research purposes. AFP, UPI and IANS news wire stories are copyright Agence France-Presse, United Press International and Indo-Asia News Service. ESA news reports are copyright European Space Agency. All NASA sourced material is public domain. Additional copyrights may apply in whole or part to other bona fide parties. All articles labeled "by Staff Writers" include reports supplied to Space Media Network by industry news wires, PR agencies, corporate press officers and the like. Such articles are individually curated and edited by Space Media Network staff on the basis of the report's information value to our industry and professional readership. Advertising does not imply endorsement, agreement or approval of any opinions, statements or information provided by Space Media Network on any Web page published or hosted by Space Media Network. General Data Protection Regulation (GDPR) Statement Our advertisers use various cookies and the like to deliver the best ad banner available at one time. All network advertising suppliers have GDPR policies (Legitimate Interest) that conform with EU regulations for data collection. By using our websites you consent to cookie based advertising. If you do not agree with this then you must stop using the websites from May 25, 2018. Privacy Statement. Additional information can be found here at About Us.