T16 - 3DUX: HCI User Experience Design for Immersive Systems and 3D Environments

Saturday, 27 July 2019, 13:30 – 17:30
Back to Tutorials' Program


Amy Banić, Ph.D. (short bio)

University of Wyoming, Laramie, WY
Idaho National Laboratory, USA



Participants in this half-day tutorial will:

  • Learn about low-cost immersive systems (input and output hardware).
  • Learn how to utilize these hardware solutions.
  • Be provided with hands-on instruction of APIs to serve as a base for 3D UI.
  • Learn about 3D UI components and design as they relate to immersive systems.
  • Learn how these issues relate to the design of user-interface components (metaphors, mental models, navigation, interaction, and appearance) for 3D environments.
  • Learn about the cognitive and perception issues and challenges for designing interaction techniques for immersive environments that affect 3D UX.
  • Learn the metrics and tools successful for evaluation of 3D UI and 3D UX in Immersive VR/AR systems.


Content and Benefits:

This half-day tutorial will focus on the following content:

  • Discussion of the challenges in designing for good 3D User Experiences.
  • Terminology of Immersive systems (hardware and software) and 3D UI design components and issues, including hardware and software lists.
  • Instructions for use of basic input technologies for immersive environments 3D UI/ 3D UX design methodology.
  • Discussion of cognitive and perception issues and challenges for designing interaction for immersive environments, stimulated by provided examples.
  • Advanced metrics to evaluate User Experiences with VR/AR/Mixed Reality systems.

With 3D technology and immersive environments becoming more popular, this tutorial will allow traditional HCI researchers, professionals, developers, UI/UX designers, etc. to initiate work in 3D UI for immersive environments. This tutorial is focused on introductory concepts and basic lowcost technology and open-source software, new 3D UI/ 3D UX issues faced when designing for 3D environments and immersive technology, and useful metrics/tools for evaluating 3D UI/ 3D UX and user experience in AR/VR/Mixed Reality systems.


Target Audience:

Target audience for this tutorial include traditional HCI/CHI/UI/UX designers, analysts, developers, usability professionals, cognitive scientists, visual and interaction designers, ethnographers, and other professionals in HCI who may know relatively little about 3D UI / 3D UX design for immersive systems and 3D environments who may want to or already would like to initiate work in this area. Additionally, this tutorial will be of interest to those who may be interested in User Experience Design for any Immersive Environments in the Mixed Reality spectrum.

Bio Sketch of Presenter:

Amy Banić is an Associate Professor of Computer Science at the University of Wyoming (UWYO) and holds a joint appointment at the Idaho National Laboratory. Her research focus is 3D User Interfaces and Interaction Techniques for Virtual Environments, Immersive Visualizations, and Virtual Humans, with a primary focus on bimanual, collaborative, and multi-modal interaction. Learn more at www.AmyBanic.com.

Dr. Banić is the founder and director of the 3D Interaction and Agents (3DIA) research lab at UWYO. She also mentors the VR InnoVRtors student maker group at UWYO. Prior to her appointment at UWYO in 2010 held a Post-Doctoral Fellowship position in the Virtual Environments Group at Clemson University, School of Computing. in 2009, she received her Ph.D in 3D User Interfaces and Virtual Environments in 2008 as well as her M.S. in 2005 from the University of North Carolina at Charlotte. She received her B.S. in CS and B.A. in Studio Arts from Duquesne University in 2003.