Control-display affordances in simulation based education

Sam Harper; Aparajithan Sivanathan; Theodore Lim; Scott McGibbon; James Millar Ritchie

doi:10.1115/DETC2018-85352

Control-display affordances in simulation based education

Sam Harper, Aparajithan Sivanathan, Theodore Lim, Scott McGibbon, James Millar Ritchie

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

Mixed reality opens new ways of connecting users to virtual content. With simulation-based education and training (SBET), mixed reality offers an enriched environment to experience digital learning. In turn, learners can develop their mental models to process and connect 2D/3D information in real-world settings. This paper reports on the use of the Microsoft HoloLens to create a mixed reality SBET environment. The challenges of this investigation are harmonising augmented real-world content, including the use of real-time, low-latency tracking of tangible objects and the interaction of these with the augmented content. The research emphasis is on technology-mediated affordances. For example, what affordance does the HoloLens provide the leaner in terms of interactive manipulation or navigation in the virtual environment? We examine this through control-display (CD) gain in conjunction with cyber-physical systems (CPS) approaches. This work builds on previously attained knowledge from the creation of an AR application for vocational education and training (VET) of stonemasonry.

Original language	English
Title of host publication	ASME 2018 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference
Publisher	American Society of Mechanical Engineers
Volume	1B
ISBN (Print)	9780791851739
DOIs	https://doi.org/10.1115/DETC2018-85352
Publication status	Published - 2018
Event	38th Computers and Information in Engineering Conference 2018 - Quebec City, Canada Duration: 26 Aug 2018 → 29 Aug 2018

Conference

Conference	38th Computers and Information in Engineering Conference 2018
Country/Territory	Canada
City	Quebec City
Period	26/08/18 → 29/08/18

Keywords

Mixed reality
Control-display gain
HoloLens
Cyber-physical system
vocational education and training

ASJC Scopus subject areas

Human-Computer Interaction
Computer Science Applications
Building and Construction
Safety, Risk, Reliability and Quality

Access to Document

10.1115/DETC2018-85352

Cite this

Harper, S., Sivanathan, A., Lim, T., McGibbon, S., & Ritchie, J. M. (2018). Control-display affordances in simulation based education. In ASME 2018 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference (Vol. 1B). Article DETC2018-85352 American Society of Mechanical Engineers. https://doi.org/10.1115/DETC2018-85352

@inproceedings{f1ab259acb37465997417fd69d38bb49,

title = "Control-display affordances in simulation based education",

abstract = "Mixed reality opens new ways of connecting users to virtual content. With simulation-based education and training (SBET), mixed reality offers an enriched environment to experience digital learning. In turn, learners can develop their mental models to process and connect 2D/3D information in real-world settings. This paper reports on the use of the Microsoft HoloLens to create a mixed reality SBET environment. The challenges of this investigation are harmonising augmented real-world content, including the use of real-time, low-latency tracking of tangible objects and the interaction of these with the augmented content. The research emphasis is on technology-mediated affordances. For example, what affordance does the HoloLens provide the leaner in terms of interactive manipulation or navigation in the virtual environment? We examine this through control-display (CD) gain in conjunction with cyber-physical systems (CPS) approaches. This work builds on previously attained knowledge from the creation of an AR application for vocational education and training (VET) of stonemasonry.",

keywords = "Mixed reality, Control-display gain, HoloLens, Cyber-physical system, vocational education and training",

author = "Sam Harper and Aparajithan Sivanathan and Theodore Lim and Scott McGibbon and Ritchie, {James Millar}",

year = "2018",

doi = "10.1115/DETC2018-85352",

language = "English",

isbn = "9780791851739",

volume = "1B",

booktitle = "ASME 2018 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference",

publisher = "American Society of Mechanical Engineers",

address = "United States",

note = "38th Computers and Information in Engineering Conference 2018 ; Conference date: 26-08-2018 Through 29-08-2018",

}

Harper, S, Sivanathan, A, Lim, T, McGibbon, S & Ritchie, JM 2018, Control-display affordances in simulation based education. in ASME 2018 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference. vol. 1B, DETC2018-85352, American Society of Mechanical Engineers, 38th Computers and Information in Engineering Conference 2018, Quebec City, Quebec, Canada, 26/08/18. https://doi.org/10.1115/DETC2018-85352

Control-display affordances in simulation based education. / Harper, Sam; Sivanathan, Aparajithan; Lim, Theodore et al.
ASME 2018 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference. Vol. 1B American Society of Mechanical Engineers, 2018. DETC2018-85352.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - Control-display affordances in simulation based education

AU - Harper, Sam

AU - Sivanathan, Aparajithan

AU - Lim, Theodore

AU - McGibbon, Scott

AU - Ritchie, James Millar

PY - 2018

Y1 - 2018

N2 - Mixed reality opens new ways of connecting users to virtual content. With simulation-based education and training (SBET), mixed reality offers an enriched environment to experience digital learning. In turn, learners can develop their mental models to process and connect 2D/3D information in real-world settings. This paper reports on the use of the Microsoft HoloLens to create a mixed reality SBET environment. The challenges of this investigation are harmonising augmented real-world content, including the use of real-time, low-latency tracking of tangible objects and the interaction of these with the augmented content. The research emphasis is on technology-mediated affordances. For example, what affordance does the HoloLens provide the leaner in terms of interactive manipulation or navigation in the virtual environment? We examine this through control-display (CD) gain in conjunction with cyber-physical systems (CPS) approaches. This work builds on previously attained knowledge from the creation of an AR application for vocational education and training (VET) of stonemasonry.

AB - Mixed reality opens new ways of connecting users to virtual content. With simulation-based education and training (SBET), mixed reality offers an enriched environment to experience digital learning. In turn, learners can develop their mental models to process and connect 2D/3D information in real-world settings. This paper reports on the use of the Microsoft HoloLens to create a mixed reality SBET environment. The challenges of this investigation are harmonising augmented real-world content, including the use of real-time, low-latency tracking of tangible objects and the interaction of these with the augmented content. The research emphasis is on technology-mediated affordances. For example, what affordance does the HoloLens provide the leaner in terms of interactive manipulation or navigation in the virtual environment? We examine this through control-display (CD) gain in conjunction with cyber-physical systems (CPS) approaches. This work builds on previously attained knowledge from the creation of an AR application for vocational education and training (VET) of stonemasonry.

KW - Mixed reality

KW - Control-display gain

KW - HoloLens

KW - Cyber-physical system

KW - vocational education and training

U2 - 10.1115/DETC2018-85352

DO - 10.1115/DETC2018-85352

M3 - Conference contribution

SN - 9780791851739

VL - 1B

BT - ASME 2018 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference

PB - American Society of Mechanical Engineers

T2 - 38th Computers and Information in Engineering Conference 2018

Y2 - 26 August 2018 through 29 August 2018

ER -

Control-display affordances in simulation based education

Abstract

Conference

Keywords

ASJC Scopus subject areas

Access to Document

Fingerprint

Cite this