Blended Spaces: Perception and Interaction in Projection-Based Spatial Augmented Reality Environments

Abstract

The reality-virtuality continuum defined by Milgram encompasses technological approaches to mix real and computer-generated content to create virtually enriched experiences. Most of today’s applications can be assigned to a discrete stage within this continuum, but cannot take full advantage of the individual characteristics of each of the other stages. In this thesis, we introduce the concept of Blended Spaces to describe environments, in which (i) objects can transition between real, mixed, and virtual states, (ii) objects with different states can interact with each other, and (iii) users can experience the resulting real, Augmented Reality (AR), Augmented Virtuality (AV), and Virtual Reality (VR) conditions seamlessly. To implement such Blended Spaces, we exploit spatial projection-based AR technology. The resulting characteristics of Blended Spaces create new challenges in terms of their technical feasibility, their visual perception, and their support of collaboration; all of which will be investigated in detail in the scope of this thesis.