Physical keyboards make virtual reality typing easier
by Staff Writers
Houghton, MI (SPX) May 16, 2017
Cranking out text is an integral part of our digital lives, but it's a field of research that has a surprising lack of emphasis in virtual reality (VR) development.
"Lots of people are buying head-mounted displays, but it's mostly for video games," says Scott Kuhl, an associate professor of computer science at Michigan Tech. "We're trying to figure out how we can use a head-mounted display for office work like writing and editing a document or sending a message to someone."
James Walker, a lecturer in computer science, led the research as part of his dissertation, working with Kuhl. He says the challenge stems from the fact that people need to see what they're typing - a bit difficult with an over-eye headset on - so he developed a light-up virtual keyboard synced with a physical keyboard. This virtual keyboard lets a VR typist see in the head-mounted display what keys they typed on the physical keyboard.
Other VR typing systems rely on either mid-air virtual keyboards or overlaying of real-world video into the VR display. But both approaches require extra equipment such as tracking cameras that can be error-prone and intrusive. People's texting performance also declines with only virtual keyboards.
"Typing in mid-air is very fatiguing," Walker says. "Our solution is noteworthy because it enables people to continue using their physical peripherals, which gives the best performance, and it doesn't need any extra hardware or require superimposing a video feed into the virtual environment."
To assess the effectiveness of a physical keyboard, Walker conducted an experiment in which participants typed on a keyboard they couldn't see. In one part, participants wore a head-mounted display - in this case, an Oculus Rift. In the other part, participants used a desktop monitor with their view of the keyboard occluded by a cover. In each part, Walker tested participants' performance with and without his virtual keyboard.
To start, a large number of people reported their typing prowess to be expert or at least proficient. Being human, participants made mistakes - lots of them - especially those without the virtual keyboard lighting up keys. That makes this experiment a perfect set-up not just for testing VR text hardware, but also to examine how autocorrect fits in.
"People underappreciate the redundancy in natural language," says Keith Vertanen, an assistant professor of computer science who assisted Walker and Kuhl with a language model to correct participants' typing. "Our recognition touch screen program, VelociTap, is extremely accurate as it's been trained on billions of words."
Still, Vertanen says he and the rest of the team were pleasantly surprised by how well the autocorrect algorithm shifted from its touch screen origins to predicting intended letters on a physical keyboard. In addition, the team observed that error rates declined as people continued typing with the VelociTap feedback and the model corrected about two-thirds of the text errors.
Seattle (AFP) May 11, 2017
Microsoft on Thursday debuted hardware for reaching into virtual worlds powered by its technology as it looked to "mixed reality" as the next big computing platform. An update coming to Windows 10 operating system later this year will "see the magic of mixed reality brought to consumers around the world," Microsoft executive vice president Terry Myerson said at the company's annual Build dev ... read more
Michigan Technological University
Space Technology News - Applications and Research
|The content herein, unless otherwise known to be public domain, are Copyright 1995-2024 - Space Media Network. All websites are published in Australia and are solely subject to Australian law and governed by Fair Use principals for news reporting and research purposes. AFP, UPI and IANS news wire stories are copyright Agence France-Presse, United Press International and Indo-Asia News Service. ESA news reports are copyright European Space Agency. All NASA sourced material is public domain. Additional copyrights may apply in whole or part to other bona fide parties. All articles labeled "by Staff Writers" include reports supplied to Space Media Network by industry news wires, PR agencies, corporate press officers and the like. Such articles are individually curated and edited by Space Media Network staff on the basis of the report's information value to our industry and professional readership. Advertising does not imply endorsement, agreement or approval of any opinions, statements or information provided by Space Media Network on any Web page published or hosted by Space Media Network. General Data Protection Regulation (GDPR) Statement Our advertisers use various cookies and the like to deliver the best ad banner available at one time. All network advertising suppliers have GDPR policies (Legitimate Interest) that conform with EU regulations for data collection. By using our websites you consent to cookie based advertising. If you do not agree with this then you must stop using the websites from May 25, 2018. Privacy Statement. Additional information can be found here at About Us.