Towards a Multimodal Measure for Physiological Behaviours to Estimate Cognitive Load

Muneeb Imtiaz Ahmad; David A. Robb; Ingo Keller; Katrin Lohan

doi:10.1007/978-3-030-49044-7_1

Towards a Multimodal Measure for Physiological Behaviours to Estimate Cognitive Load

Muneeb Imtiaz Ahmad, David A. Robb, Ingo Keller, Katrin Lohan

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

3 Citations (Scopus)

106 Downloads (Pure)

Abstract

We present an experiment investigating the relationships between different physiological measures, including Mean Pupil Diameter Change, Blinking-Rate, Heart-Rate, and Heart-Rate Variability to inform the development of a measure to estimate Cognitive Load. Our experiment involved participants performing a task to spot correct or incorrect words and sentences which successfully induced Cognitive Load. Our results show that participants’ task performance predicts their subjective rating of Cognitive Load and that there was a decrease in participants’ performance with an increase in Cognitive Load. Furthermore, Mean Pupil Diameter Change was able to predict Blinking-Rate, and Heart-Rate was able to predict Heart-Rate Variability. This prediction is evidence that collecting data on physiological behaviours synchronously and analysing the trends can be an effective way of estimating Cognitive Load, and will help the future development of an online measure of Cognitive Load useful for responsive user interfaces.

Original language	English
Title of host publication	Engineering Psychology and Cognitive Ergonomics. Mental Workload, Human Physiology, and Human Energy. HCII 2020
Editors	Don Harris, Wen-Chin Li
Publisher	Springer
Pages	3-13
Number of pages	11
ISBN (Electronic)	9783030490447
ISBN (Print)	9783030490430
DOIs	https://doi.org/10.1007/978-3-030-49044-7_1
Publication status	Published - 10 Jul 2020
Event	22nd International Conference on Human-Computer Interaction 2020 - AC Bella Sky Hotel and Bella Center, Copenhagen, Denmark, Copenhagen, Denmark Duration: 19 Jul 2020 → 24 Jul 2020 Conference number: 22 http://2020.hci.international

Publication series

Name	Lecture Notes in Computer Science
Volume	12186
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	22nd International Conference on Human-Computer Interaction 2020
Country/Territory	Denmark
City	Copenhagen
Period	19/07/20 → 24/07/20
Internet address	http://2020.hci.international

Keywords

Cognitive load
Human-computer interaction
Mental load
Pupillometry

ASJC Scopus subject areas

Theoretical Computer Science
General Computer Science

Access to Document

10.1007/978-3-030-49044-7_1

Download pdf
© Springer Nature Switzerland AG 2020
Accepted author manuscript, 858 KBLicence: All Rights Reserved

Cite this

Ahmad, M. I., Robb, D. A., Keller, I., & Lohan, K. (2020). Towards a Multimodal Measure for Physiological Behaviours to Estimate Cognitive Load. In D. Harris, & W.-C. Li (Eds.), Engineering Psychology and Cognitive Ergonomics. Mental Workload, Human Physiology, and Human Energy. HCII 2020 (pp. 3-13). (Lecture Notes in Computer Science; Vol. 12186). Springer. https://doi.org/10.1007/978-3-030-49044-7_1

@inproceedings{a9df2836b6814a2485bb3c7ae40ac152,

title = "Towards a Multimodal Measure for Physiological Behaviours to Estimate Cognitive Load",

abstract = "We present an experiment investigating the relationships between different physiological measures, including Mean Pupil Diameter Change, Blinking-Rate, Heart-Rate, and Heart-Rate Variability to inform the development of a measure to estimate Cognitive Load. Our experiment involved participants performing a task to spot correct or incorrect words and sentences which successfully induced Cognitive Load. Our results show that participants{\textquoteright} task performance predicts their subjective rating of Cognitive Load and that there was a decrease in participants{\textquoteright} performance with an increase in Cognitive Load. Furthermore, Mean Pupil Diameter Change was able to predict Blinking-Rate, and Heart-Rate was able to predict Heart-Rate Variability. This prediction is evidence that collecting data on physiological behaviours synchronously and analysing the trends can be an effective way of estimating Cognitive Load, and will help the future development of an online measure of Cognitive Load useful for responsive user interfaces.",

keywords = "Cognitive load, Human-computer interaction, Mental load, Pupillometry",

author = "Ahmad, {Muneeb Imtiaz} and Robb, {David A.} and Ingo Keller and Katrin Lohan",

year = "2020",

month = jul,

day = "10",

doi = "10.1007/978-3-030-49044-7_1",

language = "English",

isbn = "9783030490430",

series = "Lecture Notes in Computer Science",

publisher = "Springer",

pages = "3--13",

editor = "Don Harris and Wen-Chin Li",

booktitle = "Engineering Psychology and Cognitive Ergonomics. Mental Workload, Human Physiology, and Human Energy. HCII 2020",

note = "22nd International Conference on Human-Computer Interaction 2020 ; Conference date: 19-07-2020 Through 24-07-2020",

url = "http://2020.hci.international",

}

Ahmad, MI, Robb, DA, Keller, I & Lohan, K 2020, Towards a Multimodal Measure for Physiological Behaviours to Estimate Cognitive Load. in D Harris & W-C Li (eds), Engineering Psychology and Cognitive Ergonomics. Mental Workload, Human Physiology, and Human Energy. HCII 2020. Lecture Notes in Computer Science, vol. 12186, Springer, pp. 3-13, 22nd International Conference on Human-Computer Interaction 2020, Copenhagen, Denmark, 19/07/20. https://doi.org/10.1007/978-3-030-49044-7_1

Towards a Multimodal Measure for Physiological Behaviours to Estimate Cognitive Load. / Ahmad, Muneeb Imtiaz; Robb, David A.; Keller, Ingo et al.
Engineering Psychology and Cognitive Ergonomics. Mental Workload, Human Physiology, and Human Energy. HCII 2020. ed. / Don Harris; Wen-Chin Li. Springer, 2020. p. 3-13 (Lecture Notes in Computer Science; Vol. 12186).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - Towards a Multimodal Measure for Physiological Behaviours to Estimate Cognitive Load

AU - Ahmad, Muneeb Imtiaz

AU - Robb, David A.

AU - Keller, Ingo

AU - Lohan, Katrin

N1 - Conference code: 22

PY - 2020/7/10

Y1 - 2020/7/10

N2 - We present an experiment investigating the relationships between different physiological measures, including Mean Pupil Diameter Change, Blinking-Rate, Heart-Rate, and Heart-Rate Variability to inform the development of a measure to estimate Cognitive Load. Our experiment involved participants performing a task to spot correct or incorrect words and sentences which successfully induced Cognitive Load. Our results show that participants’ task performance predicts their subjective rating of Cognitive Load and that there was a decrease in participants’ performance with an increase in Cognitive Load. Furthermore, Mean Pupil Diameter Change was able to predict Blinking-Rate, and Heart-Rate was able to predict Heart-Rate Variability. This prediction is evidence that collecting data on physiological behaviours synchronously and analysing the trends can be an effective way of estimating Cognitive Load, and will help the future development of an online measure of Cognitive Load useful for responsive user interfaces.

AB - We present an experiment investigating the relationships between different physiological measures, including Mean Pupil Diameter Change, Blinking-Rate, Heart-Rate, and Heart-Rate Variability to inform the development of a measure to estimate Cognitive Load. Our experiment involved participants performing a task to spot correct or incorrect words and sentences which successfully induced Cognitive Load. Our results show that participants’ task performance predicts their subjective rating of Cognitive Load and that there was a decrease in participants’ performance with an increase in Cognitive Load. Furthermore, Mean Pupil Diameter Change was able to predict Blinking-Rate, and Heart-Rate was able to predict Heart-Rate Variability. This prediction is evidence that collecting data on physiological behaviours synchronously and analysing the trends can be an effective way of estimating Cognitive Load, and will help the future development of an online measure of Cognitive Load useful for responsive user interfaces.

KW - Cognitive load

KW - Human-computer interaction

KW - Mental load

KW - Pupillometry

UR - http://www.scopus.com/inward/record.url?scp=85088751559&partnerID=8YFLogxK

U2 - 10.1007/978-3-030-49044-7_1

DO - 10.1007/978-3-030-49044-7_1

M3 - Conference contribution

SN - 9783030490430

T3 - Lecture Notes in Computer Science

SP - 3

EP - 13

BT - Engineering Psychology and Cognitive Ergonomics. Mental Workload, Human Physiology, and Human Energy. HCII 2020

A2 - Harris, Don

A2 - Li, Wen-Chin

PB - Springer

T2 - 22nd International Conference on Human-Computer Interaction 2020

Y2 - 19 July 2020 through 24 July 2020

ER -

Towards a Multimodal Measure for Physiological Behaviours to Estimate Cognitive Load

Abstract

Publication series

Conference

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this