Multisensory View Management for Augmented Reality

Augmented reality (AR) is a field of research that has seen a steep incline in attention over the last years. Recently, it has been driven by simple cell phone applications as well as the appearance of low-cost head-worn display devices such as Google Glass, and will likely see further uptake through Microsoft Hololens.

Nonetheless, the field of research itself has steadily been growing for well over a decade, driven primarily by research systems, but also by increasing industry interest. The basic premise of AR is the overlay of digital imagery over real-world footage. However, how we present information in an effective way, reflecting the potential and limitations of the human perceptual system, is still an open issue. To improve the usability and performance of AR systems and applications, perceptual issues must be approached systematically: there is a need to understand the mechanisms behind these problems, to derive requirements and subsequently find solutions to mitigate effects.

To focus our scope, in the proposed work we will predominantly look into advancing view management techniques, while mainly dealing with labels as main information visualization technique. Labels are the predominant mode of information communication in most AR applications and highly intertwined with view management. Labels generally hold text, numerical data or small graphical representations in a flag-like form that point towards the real-world object it refers to. The management thereof can be very challenging: for example, it may be required to order a larger number of labels that likely cause clutter and occlusion, which results in difficulties processing the provided information. Hence, without adequate view management techniques we will not be able to design effective interfaces especially when complexity rises. This is especially true once a narrow field-of-view (FOV) head-worn display device is used. These display devices are increasingly popular as high quality and affordable commercial versions become available and a higher uptake is expected. Yet, adequate view management methods specifically designed for narrow FOV are not available.  

Aims and Objectives

In the project, we will advance the state of the art in the following areas:

• Create a benchmark system that supports the research effort – it is specifically intended to create a platform for performing validations und comparative conditions, both within the frame of the research program as well as by other researchers.
• Create a better understanding of perceptual and interrelated cognitive issues arising when using narrow FOV AR displays for exploring increasingly complex information, and comparing these findings to medium and wide FOV displays.
• Develop innovative view management techniques specifically tuned towards narrow FOV displays, hereby encompassing both (a) improvements to visual management of information represented through labels as well as (b) exploring the potential and developing view management methods based on auditory and tactile cues.
• Create guidelines to guide the design of novel interfaces.