Symptoms of cognitive load in interactions with a dialogue system

José Lopes; Katrin Lohan; Helen Hastie

doi:10.1145/3279810.3279851

Symptoms of cognitive load in interactions with a dialogue system

José Lopes, Katrin Lohan, Helen Hastie

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

8 Citations (Scopus)

Abstract

Humans adapt their behaviour to the perceived cognitive load of their dialogue partner, for example, delaying non-essential information. We propose that spoken dialogue systems should do the same, particularly in high-stakes scenarios, such as emergency response. In this paper, we provide a summary of the prosodic, turn-taking and other linguistic symptoms of cognitive load analysed in the literature. We then apply these features to a single corpus in the restaurant-finding domain and propose new symptoms that are evidenced through interaction with the dialogue system, including utterance entropy, speech recognition confidence, as well as others based on dialogue acts.

Original language	English
Title of host publication	Proceedings of the Workshop on Modeling Cognitive Processes from Multimodal Data
Publisher	Association for Computing Machinery
ISBN (Electronic)	9781450360722
DOIs	https://doi.org/10.1145/3279810.3279851
Publication status	Published - 16 Oct 2018
Event	2018 Workshop on Modeling Cognitive Processes from Multimodal Data - Boulder, United States Duration: 16 Oct 2018 → 16 Oct 2018

Conference

Conference	2018 Workshop on Modeling Cognitive Processes from Multimodal Data
Abbreviated title	MCPMD 2018
Country/Territory	United States
City	Boulder
Period	16/10/18 → 16/10/18

Keywords

Cognitive load
Multi-modal Systems
Spoken Dialogue Systems

ASJC Scopus subject areas

Modelling and Simulation

Access to Document

10.1145/3279810.3279851

Cite this

@inproceedings{c19458903c9148f595d768fccc63f01d,

title = "Symptoms of cognitive load in interactions with a dialogue system",

abstract = "Humans adapt their behaviour to the perceived cognitive load of their dialogue partner, for example, delaying non-essential information. We propose that spoken dialogue systems should do the same, particularly in high-stakes scenarios, such as emergency response. In this paper, we provide a summary of the prosodic, turn-taking and other linguistic symptoms of cognitive load analysed in the literature. We then apply these features to a single corpus in the restaurant-finding domain and propose new symptoms that are evidenced through interaction with the dialogue system, including utterance entropy, speech recognition confidence, as well as others based on dialogue acts.",

keywords = "Cognitive load, Multi-modal Systems, Spoken Dialogue Systems",

author = "Jos{\'e} Lopes and Katrin Lohan and Helen Hastie",

year = "2018",

month = oct,

day = "16",

doi = "10.1145/3279810.3279851",

language = "English",

booktitle = "Proceedings of the Workshop on Modeling Cognitive Processes from Multimodal Data",

publisher = "Association for Computing Machinery",

address = "United States",

note = "2018 Workshop on Modeling Cognitive Processes from Multimodal Data, MCPMD 2018 ; Conference date: 16-10-2018 Through 16-10-2018",

}

Lopes, J, Lohan, K & Hastie, H 2018, Symptoms of cognitive load in interactions with a dialogue system. in Proceedings of the Workshop on Modeling Cognitive Processes from Multimodal Data., 4, Association for Computing Machinery, 2018 Workshop on Modeling Cognitive Processes from Multimodal Data, Boulder, United States, 16/10/18. https://doi.org/10.1145/3279810.3279851

TY - GEN

T1 - Symptoms of cognitive load in interactions with a dialogue system

AU - Lopes, José

AU - Lohan, Katrin

AU - Hastie, Helen

PY - 2018/10/16

Y1 - 2018/10/16

N2 - Humans adapt their behaviour to the perceived cognitive load of their dialogue partner, for example, delaying non-essential information. We propose that spoken dialogue systems should do the same, particularly in high-stakes scenarios, such as emergency response. In this paper, we provide a summary of the prosodic, turn-taking and other linguistic symptoms of cognitive load analysed in the literature. We then apply these features to a single corpus in the restaurant-finding domain and propose new symptoms that are evidenced through interaction with the dialogue system, including utterance entropy, speech recognition confidence, as well as others based on dialogue acts.

AB - Humans adapt their behaviour to the perceived cognitive load of their dialogue partner, for example, delaying non-essential information. We propose that spoken dialogue systems should do the same, particularly in high-stakes scenarios, such as emergency response. In this paper, we provide a summary of the prosodic, turn-taking and other linguistic symptoms of cognitive load analysed in the literature. We then apply these features to a single corpus in the restaurant-finding domain and propose new symptoms that are evidenced through interaction with the dialogue system, including utterance entropy, speech recognition confidence, as well as others based on dialogue acts.

KW - Cognitive load

KW - Multi-modal Systems

KW - Spoken Dialogue Systems

UR - http://www.scopus.com/inward/record.url?scp=85058263872&partnerID=8YFLogxK

U2 - 10.1145/3279810.3279851

DO - 10.1145/3279810.3279851

M3 - Conference contribution

AN - SCOPUS:85058263872

BT - Proceedings of the Workshop on Modeling Cognitive Processes from Multimodal Data

PB - Association for Computing Machinery

T2 - 2018 Workshop on Modeling Cognitive Processes from Multimodal Data

Y2 - 16 October 2018 through 16 October 2018

ER -

Symptoms of cognitive load in interactions with a dialogue system

Abstract

Conference

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this