Abstract
Mixed Reality (MR) technologies are inspiring a wide range of applications in the Construction industry, such as visual simulation for urban and construction planning and services’ maintenance. Current MR systems offer only limited interaction modalities between the user (the trainee), the real surrounding world (including working tools and materials) and the virtual environment. Such interactions are essential for construction training applications.
Current approaches aim at providing such capabilities through the virtualization of real world to be fused with the virtual one, and usually require the complex set-up and integration of external marker-based tracking systems, immersive displays (e.g. CAVEs) and haptic devices. Moreover such approaches, being based on pre-fetched avatar models of the real objects, often result in a lack of realism and flexibility.
In this paper we present the concept of an immersive Hybrid Reality (iHR) system which allows the trainee to experience in real time a realistic perception of self-embodiment within the virtual worksite as well as realistic interaction with both real and virtual objects. Our system fuses in real time the visual and structural information of the real world, acquired by an egocentric RGB-D camera integral with a wearable immersive head mounted display, within the virtual representation of a work environment. The system is based on a recently developed commodity hardware, which is affordable and easily set-up, and therefore it has the potential for supporting a wider application across vocational training courses.
The paper outlines the implementation of the main components of the system and the benefits achieved in terms of enhanced simulation capabilities. Promising preliminary results within the context of a training scenario are discussed, together with limitations of the current implementation and directions for further improvement.
Current approaches aim at providing such capabilities through the virtualization of real world to be fused with the virtual one, and usually require the complex set-up and integration of external marker-based tracking systems, immersive displays (e.g. CAVEs) and haptic devices. Moreover such approaches, being based on pre-fetched avatar models of the real objects, often result in a lack of realism and flexibility.
In this paper we present the concept of an immersive Hybrid Reality (iHR) system which allows the trainee to experience in real time a realistic perception of self-embodiment within the virtual worksite as well as realistic interaction with both real and virtual objects. Our system fuses in real time the visual and structural information of the real world, acquired by an egocentric RGB-D camera integral with a wearable immersive head mounted display, within the virtual representation of a work environment. The system is based on a recently developed commodity hardware, which is affordable and easily set-up, and therefore it has the potential for supporting a wider application across vocational training courses.
The paper outlines the implementation of the main components of the system and the benefits achieved in terms of enhanced simulation capabilities. Promising preliminary results within the context of a training scenario are discussed, together with limitations of the current implementation and directions for further improvement.
Original language | English |
---|---|
Title of host publication | CONVR 15: Proceedings of the 15th Annual International Conference on Construction Applications of Virtual Reality, October 5-7, 2015, Banff, Alberta, Canada |
Pages | 1-10 |
Number of pages | 10 |
Publication status | Published - 5 Oct 2015 |
Event | International Conference on Construction Applications of Virtual Reality - Banff, Canada Duration: 5 Oct 2015 → 7 Oct 2015 |
Conference
Conference | International Conference on Construction Applications of Virtual Reality |
---|---|
Abbreviated title | CONVR |
Country/Territory | Canada |
City | Banff |
Period | 5/10/15 → 7/10/15 |