PAWdio: Hand input for mobile VR using acoustic sensing

Majed Al Zayer, Sam Tregillus, Eelke Folmer

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

7 Scopus citations

Abstract

Hand input offers a natural, efficient and immersive form of input for virtual reality (VR), but it has been difficult to implement on mobile VR platforms. Accurate hand-tracking requires a depth sensor and performing computer vision on a smartphone is computationally intensive, which may degrade the frame rate of a VR simulation and drain battery life. PAW-dio is a novel 1 degree of freedom (DOF) hand input technique that uses acoustic sensing to track the relative position of an earbud from a headset that the user holds in their hand. PAW-dio requires no instrumentation and its low computational overhead assures a high frame rate. A user study with 18 subjects evaluates PAWdio with button input that is commonly available on VR adapters. Results with a 3D target selection task found a similar accuracy and usability, a significantly slower performance, but higher immersion for PAWdio. We discuss limitations and game applications of PAWdio.

Original languageEnglish
Title of host publicationCHI PLAY 2016 - Proceedings of the 2016 Annual Symposium on Computer-Human Interaction in Play
PublisherAssociation for Computing Machinery, Inc
Pages154-158
Number of pages5
ISBN (Electronic)9781450344562
DOIs
StatePublished - 16 Oct 2016
Externally publishedYes
Event3rd ACM SIGCHI Annual Symposium on Computer-Human Interaction in Play, CHI PLAY 2016 - Austin, United States
Duration: 16 Oct 201619 Oct 2016

Publication series

NameCHI PLAY 2016 - Proceedings of the 2016 Annual Symposium on Computer-Human Interaction in Play

Conference

Conference3rd ACM SIGCHI Annual Symposium on Computer-Human Interaction in Play, CHI PLAY 2016
Country/TerritoryUnited States
CityAustin
Period16/10/1619/10/16

Keywords

  • Acoustic sensing, virtual reality
  • Games
  • Hand tracking
  • Head-mounted display
  • Immersion
  • Natural input
  • Switch input

ASJC Scopus subject areas

  • Human-Computer Interaction

Fingerprint

Dive into the research topics of 'PAWdio: Hand input for mobile VR using acoustic sensing'. Together they form a unique fingerprint.

Cite this