An immersive hybrid reality system for construction training

Ludovico Carozza, Frederic Nicolas Bosche, Mohamed Samir Abdel-Wahab

Research output: Chapter in Book/Report/Conference proceedingConference contribution

136 Downloads (Pure)


Mixed Reality (MR) technologies are inspiring a wide range of applications in the Construction industry, such as visual simulation for urban and construction planning and services’ maintenance. Current MR systems offer only limited interaction modalities between the user (the trainee), the real surrounding world (including working tools and materials) and the virtual environment. Such interactions are essential for construction training applications.
Current approaches aim at providing such capabilities through the virtualization of real world to be fused with the virtual one, and usually require the complex set-up and integration of external marker-based tracking systems, immersive displays (e.g. CAVEs) and haptic devices. Moreover such approaches, being based on pre-fetched avatar models of the real objects, often result in a lack of realism and flexibility.
In this paper we present the concept of an immersive Hybrid Reality (iHR) system which allows the trainee to experience in real time a realistic perception of self-embodiment within the virtual worksite as well as realistic interaction with both real and virtual objects. Our system fuses in real time the visual and structural information of the real world, acquired by an egocentric RGB-D camera integral with a wearable immersive head mounted display, within the virtual representation of a work environment. The system is based on a recently developed commodity hardware, which is affordable and easily set-up, and therefore it has the potential for supporting a wider application across vocational training courses.
The paper outlines the implementation of the main components of the system and the benefits achieved in terms of enhanced simulation capabilities. Promising preliminary results within the context of a training scenario are discussed, together with limitations of the current implementation and directions for further improvement.
Original languageEnglish
Title of host publicationCONVR 15: Proceedings of the 15th Annual International Conference on Construction Applications of Virtual Reality, October 5-7, 2015, Banff, Alberta, Canada
Number of pages10
Publication statusPublished - 5 Oct 2015
EventInternational Conference on Construction Applications of Virtual Reality - Banff, Canada
Duration: 5 Oct 20157 Oct 2015


ConferenceInternational Conference on Construction Applications of Virtual Reality
Abbreviated titleCONVR


Dive into the research topics of 'An immersive hybrid reality system for construction training'. Together they form a unique fingerprint.

Cite this