T12: Bimanual Interaction in Virtual and Augmented Reality

Saturday, 27 July 2019, 08:30 – 12:30
Back to Tutorials' Program

 

Amy Banić, Ph.D. (short bio)

University of Wyoming, Laramie, WY
Idaho National Laboratory, USA

 

Objectives:

Participants in this half-day tutorial will:

  • Learn different methods of how to set up and control virtual and augmented reality environments using one and two handed interaction techniques.
  • Learn about low-cost tracking systems (input and output hardware) to control virtual and augmented reality environments with two hands.
  • Learn how to interface these solutions with virtual environments.
  • Be provided with hands-on instruction using existing APIs and code demonstrations.
  • Learn about how to design handedness control for selection, manipulation, and even navigation.
  • Learn about the performance and fatigue issues surrounding handedness control.
  • Learn the metrics and tools for evaluation of one- and two-handed interaction techniques

 

Content and Benefits:

This half-day tutorial will focus on the following content:

  • Programming demonstrations of how to set up one- and two- handed tracking control for virtual and augmented reality environments. Multiple methods will be shown.
  • Presentation of selection, manipulation, and navigation techniques for handedness control.
  • Programming demonstrations of how to integrate handedness tracking input to selection and manipulation control.
  • Applications include virtual reality, augmented reality, multiple object selection and manipulation, and immersive volume visualization selection.
  • Discussion of the performance and fatigue issues in designing handedness interaction for virtual and augmented reality environments.
  • Advanced metrics to evaluate one- and two- handed interaction for virtual and augmented reality.

With the growth of virtual and augmented reality, this tutorial will allow virtual and augmented reality designers, developers, researchers, and other students and professionals to incorporate hand-based interaction techniques in a responsible way that ensures a good user experience. A focus is made on existing interaction techniques, but includes a discussion for designing new ones.

 

Target Audience:

Target audience for this tutorial include traditional VR/AR/HCI/UI/UX designers, analysts, developers, usability professionals, visual and interaction designers, and other professionals in HCI who may know relatively little about virtual and augmented reality, specifically incorporating hand tracking and interaction techniques for these types of environments, who may want to or already would like to initiate work in this area.

Bio Sketch of Presenter:

Amy Banić is an Associate Professor of Computer Science at the University of Wyoming (UWYO) and holds a joint appointment at the Idaho National Laboratory. Her research focus is 3D User Interfaces and Interaction Techniques for Virtual Environments, Immersive Visualizations, and Virtual Humans, with a primary focus on bimanual, collaborative, and multi-modal interaction. Learn more at www.AmyBanic.com.

Dr. Banić is the founder and director of the 3D Interaction and Agents (3DIA) research lab at UWYO. She also mentors the VR InnoVRtors student maker group at UWYO. Prior to her appointment at UWYO in 2010 held a Post-Doctoral Fellowship position in the Virtual Environments Group at Clemson University, School of Computing. in 2009, she received her Ph.D in 3D User Interfaces and Virtual Environments in 2008 as well as her M.S. in 2005 from the University of North Carolina at Charlotte. She received her B.S. in CS and B.A. in Studio Arts from Duquesne University in 2003.