CN 17 - 3D User Interfaces: From Lab to Living Room

Ernst Kruijff, Graz University of Technology
Doug Bowman, Virginia Tech
Joseph LaViola, University of Central Florida
Ivan Poupyrev, Sony Computer Science Laboratories

Over the last decade, the field of 3D user interfaces has grown out of its infancy, forming the basis for many game and industry applications. In this course, you will gain a solid background in the theory and the methods needed to create your own 3D spatial interfaces. Focusing particularly on real-world applications, we identify the particular difficulties of designing and developing spatial interfaces, carefully embedding the latest evaluation results. In addition,the course will address novel research themes such as 3D interaction for large displays and games; and integrating 3DUIs with mobile devices, robotics, and the environment.

This course has evolved from courses given at SIGGRAPH 2000, 2001 and 2004, and the book "3D User Interfaces: Theory and Practice" (Addison-Wesley 2005), written by the instructors. In the course we will balance presentation of basic, fundamental principles of 3DUI design that can be found in the book with new, emerging areas of 3DUI theory and practice.


  • Theory and practice for 3D interaction in desktop / console, large-screen, augmented reality, or virtual reality setups
  • Lab and real-world interactive scenarios, including interfaces for/with video games, robotics, and ubiquitous computing
  • Fundamental and advanced 3D interaction techniques, metaphors, and design strategies
  • Issues and trends in tangible / haptic interfaces
  • Practical tips for developing re-usable hardware interfaces

The intended audience is anyone interested in learning about 3DUIs for both research and real-world applications. Selected course blocks will also be interesting for those who deal with interface, design, and human factors issues related to 3D video games, animation and modelling, and the arts. A basic background in HCI is preferred.

The course will largely consist of lectures that include selected case studies, videos, and live demonstrations.

Instructor background:
Ernst Kruijff is a Senior Researcher in the Institute for Computer Graphics and Vision at the Graz University of Technology, currently working on spatial interfaces for mobile applications and experimental control devices.

Doug A. Bowman is an Associate Professor of Computer Science and member of the Center for Human-Computer Interaction at Virginia Tech. His research interests include the benefits of immersion and domain-specific 3D interaction.

Joseph J. LaViola Jr. is an Assistant Professor at the University of Central Florida as well as an Adjunct Assistant Research Professor at Brown University. His research interests include pen-based interactive computing, 3D interaction techniques, multimodal interaction in virtual environments, and user interface evaluation.

Ivan Poupyrev is a Researcher in the Interaction Lab at Sony Computer Science Laboratories,investigating novel interaction paradigms in mobile and handheld computing, tactile andhaptic interaction, tangible interaction, augmented and virtual reality, and three-dimensional interfaces.

More information on previous courses can be found at