Department of Computer Science

DFG-funded augmented reality project has kicked off

Wednesday 14 June 2017

State-of-the-art technology for the new project: The HoloLens has arrived! The mixeed-reality device projects interactive three-dimensional content into the real life environment of its user. Dr. Ernst Kruijff and his team are joined by scientists from the US and Japan to develop a novel augmented reality system with visual, tactile and auditive cues. The project is funded by Deutsche Forschungsgemeinschaft (DFG).

20170608_fbinf_ernst_hololens.jpg (DE)

Ernst Kruijff has been cooperating with japanese scientists from Osaka since 2014 to improve the noticeability of augmented information in the peripheral visual field of 3D-devices.

The displays being used were different from the ones in the current project: The glasses were more like a helmet with the benefit of a wider field of view. However, the same fundamental question occured: How can the users view be directed towards important information in the peripheral visual field?

 

2014_05_japan_dfg_kollage.png (DE)
20170607_fbinf_kruijff_vr_mlh_034.jpeg (DE)

The new DFG-funded project "Multisensory View Management for Augmented Reality" kicked off on May 1st 2017. The original group was joined by partners from the US (Columbia University und Mississippi State University). The H-BRS team consists of  Dr. Ernst Kruijff, Jens Maiero, Alexander Marquardt and Christina Trepkowski.

The HoloLens that is used for the current tests has a comparably narrow field of vision of only 40°. Thus the crucial task is not to confuse the user with an abundance of visual information within this limited space.

Therefore the team aims to implement a novel multisensory approach to view management involving multisensory cues. Some of the visual information is "translated" into tactile and auditive cues. Testing will be carried out under controlled lab conditions as well as in a real-life environment. For this purpose, the H-BRS researchers will  travel to New York and to the Mississippi State University this autumn. The project is expected to contribute significantly to fundamental research in the field of multisensory view management. The results will be highly relevant for various systems and applications.

 

The Institute of Visual Computing  highly appreciates the funding of this long term project through Deutsche Forschungsgemeinschaft (DFG).