Sensitivity of Trust Scales in the Face of Errors

Birthe Nesset; Gnanathusharan Rajendran; Jose David Águas Lopes; Helen Hastie

doi:10.1109/HRI53351.2022.9889427

Sensitivity of Trust Scales in the Face of Errors

Birthe Nesset, Gnanathusharan Rajendran, Jose David Águas Lopes, Helen Hastie

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

1 Citation (Scopus)

11 Downloads (Pure)

Abstract

Trust between humans and robots is a complex, multifaceted phenomenon and measuring it subjectively and reliably is challenging. It is also context dependent and so choosing the right tool for a specific study can prove difficult. This paper aims to evaluate various trust measures and compare them in terms of sensitivity to changes in trust. This is done by comparing two validated trust questionnaires (TAS and MDMT) and one single item assessment in a COVID-19 triage scenario. We found that trust measures are equivalent in terms of sensitivity to changes in trust. Furthermore, the study showed that trust could be measured similarly through a single item assessment in comparison with other lengthier scales, in scenarios with distinct breaks in trust. This finding would be of use for experiments where lengthy questionnaires are not appropriate, such as those in the wild.

Original language	English
Title of host publication	17th ACM/IEEE International Conference on Human-Robot Interaction (HRI)
Publisher	IEEE
Pages	950-954
Number of pages	5
ISBN (Electronic)	9781665407311
DOIs	https://doi.org/10.1109/HRI53351.2022.9889427
Publication status	Published - 29 Sept 2022
Event	17th Annual ACM/IEEE International Conference on Human-Robot Interaction 2022 - Online, Sapporo, Japan Duration: 7 Mar 2022 → 10 Mar 2022 https://humanrobotinteraction.org/2022/

Conference

Conference	17th Annual ACM/IEEE International Conference on Human-Robot Interaction 2022
Abbreviated title	HRI 2022
Country/Territory	Japan
City	Sapporo
Period	7/03/22 → 10/03/22
Internet address	https://humanrobotinteraction.org/2022/

Keywords

HRI
error
measure
single item assessment
trust

ASJC Scopus subject areas

Artificial Intelligence
Human-Computer Interaction
Electrical and Electronic Engineering

Access to Document

10.1109/HRI53351.2022.9889427

Download pdf
© 2022 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Accepted author manuscript, 1.37 MB

Cite this

@inproceedings{bef5bf0f81a342dd8225384e1bf29b13,

title = "Sensitivity of Trust Scales in the Face of Errors",

abstract = "Trust between humans and robots is a complex, multifaceted phenomenon and measuring it subjectively and reliably is challenging. It is also context dependent and so choosing the right tool for a specific study can prove difficult. This paper aims to evaluate various trust measures and compare them in terms of sensitivity to changes in trust. This is done by comparing two validated trust questionnaires (TAS and MDMT) and one single item assessment in a COVID-19 triage scenario. We found that trust measures are equivalent in terms of sensitivity to changes in trust. Furthermore, the study showed that trust could be measured similarly through a single item assessment in comparison with other lengthier scales, in scenarios with distinct breaks in trust. This finding would be of use for experiments where lengthy questionnaires are not appropriate, such as those in the wild.",

keywords = "HRI, error, measure, single item assessment, trust",

author = "Birthe Nesset and Gnanathusharan Rajendran and {{\'A}guas Lopes}, {Jose David} and Helen Hastie",

note = "Funding Information: ACKNOWLEDGEMENTS This work was funded and supported by the UKRI Node on Trust (EP/V026682/1). Publisher Copyright: {\textcopyright} 2022 IEEE.; 17th Annual ACM/IEEE International Conference on Human-Robot Interaction 2022, HRI 2022 ; Conference date: 07-03-2022 Through 10-03-2022",

year = "2022",

month = sep,

day = "29",

doi = "10.1109/HRI53351.2022.9889427",

language = "English",

pages = "950--954",

booktitle = "17th ACM/IEEE International Conference on Human-Robot Interaction (HRI)",

publisher = "IEEE",

address = "United States",

url = "https://humanrobotinteraction.org/2022/",

}

TY - GEN

T1 - Sensitivity of Trust Scales in the Face of Errors

AU - Nesset, Birthe

AU - Rajendran, Gnanathusharan

AU - Águas Lopes, Jose David

AU - Hastie, Helen

PY - 2022/9/29

Y1 - 2022/9/29

N2 - Trust between humans and robots is a complex, multifaceted phenomenon and measuring it subjectively and reliably is challenging. It is also context dependent and so choosing the right tool for a specific study can prove difficult. This paper aims to evaluate various trust measures and compare them in terms of sensitivity to changes in trust. This is done by comparing two validated trust questionnaires (TAS and MDMT) and one single item assessment in a COVID-19 triage scenario. We found that trust measures are equivalent in terms of sensitivity to changes in trust. Furthermore, the study showed that trust could be measured similarly through a single item assessment in comparison with other lengthier scales, in scenarios with distinct breaks in trust. This finding would be of use for experiments where lengthy questionnaires are not appropriate, such as those in the wild.

AB - Trust between humans and robots is a complex, multifaceted phenomenon and measuring it subjectively and reliably is challenging. It is also context dependent and so choosing the right tool for a specific study can prove difficult. This paper aims to evaluate various trust measures and compare them in terms of sensitivity to changes in trust. This is done by comparing two validated trust questionnaires (TAS and MDMT) and one single item assessment in a COVID-19 triage scenario. We found that trust measures are equivalent in terms of sensitivity to changes in trust. Furthermore, the study showed that trust could be measured similarly through a single item assessment in comparison with other lengthier scales, in scenarios with distinct breaks in trust. This finding would be of use for experiments where lengthy questionnaires are not appropriate, such as those in the wild.

KW - HRI

KW - error

KW - measure

KW - single item assessment

KW - trust

UR - http://www.scopus.com/inward/record.url?scp=85140738261&partnerID=8YFLogxK

U2 - 10.1109/HRI53351.2022.9889427

DO - 10.1109/HRI53351.2022.9889427

M3 - Conference contribution

SP - 950

EP - 954

BT - 17th ACM/IEEE International Conference on Human-Robot Interaction (HRI)

PB - IEEE

T2 - 17th Annual ACM/IEEE International Conference on Human-Robot Interaction 2022

Y2 - 7 March 2022 through 10 March 2022

ER -

Sensitivity of Trust Scales in the Face of Errors

Abstract

Conference

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this