Natural Language Generation enhances human decision-making with uncertain information

Dimitra Gkatzia; Oliver Lemon; Verena Rieser

doi:10.18653/v1/P16-2043

Natural Language Generation enhances human decision-making with uncertain information

Dimitra Gkatzia, Oliver Lemon, Verena Rieser

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

32 Citations (Scopus)

Abstract

Decision-making is often dependent on uncertain data, e.g. data associated with confidence scores or probabilities. We present a comparison of different information presentations for uncertain data and,for the first time, measure their effects on human decision-making. We show that the use of Natural Language Generation (NLG) improves decision-making under uncertainty, compared to state-of-the art graphical-based representation methods.In a task-based study with 442 adults,we found that presentations using NLG lead to 24% better decision-making on average than the graphical presentations, and to 44% better decision-making when NLG is combined with graphics. We also show that women achieve significantly better results when presented with NLG output(an 87% increase on average compared to graphical presentations).

Original language	English
Title of host publication	Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics
Publisher	Association for Computational Linguistics
Pages	264-268
Number of pages	5
Volume	2
ISBN (Print)	9781945626012
DOIs	https://doi.org/10.18653/v1/P16-2043
Publication status	Published - 2016
Event	54th Annual Meeting of the Association for Computational Linguistics 2016 - Berlin, Germany Duration: 7 Aug 2016 → 12 Aug 2016

Conference

Conference	54th Annual Meeting of the Association for Computational Linguistics 2016
Abbreviated title	ACL 2016
Country/Territory	Germany
City	Berlin
Period	7/08/16 → 12/08/16

Access to Document

10.18653/v1/P16-2043Licence: CC BY

https://www.aclweb.org/anthology/P/P16/P16-2043.pdfLicence: CC BY

The extended WeatherGame
Rieser, V. (Creator), Gkatzia, D. (Creator) & Lemon, O. (Creator), Heriot-Watt University, 2016
DOI: 10.17861/1412934f-6d78-4214-b8b6-26405f835588
Dataset

Verena Rieser
- V.T.Rieserhw.acuk
- School of Mathematical & Computer Sciences - Professor
- School of Mathematical & Computer Sciences, Computer Science - Professor
Person: Academic (Research & Teaching)

Cite this

@inproceedings{808332f02b494f088d7ab915a8306b5d,

title = "Natural Language Generation enhances human decision-making with uncertain information",

abstract = "Decision-making is often dependent on uncertain data, e.g. data associated with confidence scores or probabilities. We present a comparison of different information presentations for uncertain data and,for the first time, measure their effects on human decision-making. We show that the use of Natural Language Generation (NLG) improves decision-making under uncertainty, compared to state-of-the art graphical-based representation methods.In a task-based study with 442 adults,we found that presentations using NLG lead to 24% better decision-making on average than the graphical presentations, and to 44% better decision-making when NLG is combined with graphics. We also show that women achieve significantly better results when presented with NLG output(an 87% increase on average compared to graphical presentations).",

author = "Dimitra Gkatzia and Oliver Lemon and Verena Rieser",

year = "2016",

doi = "10.18653/v1/P16-2043",

language = "English",

isbn = "9781945626012",

volume = "2",

pages = "264--268",

booktitle = "Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics",

publisher = "Association for Computational Linguistics",

note = "54th Annual Meeting of the Association for Computational Linguistics 2016, ACL 2016 ; Conference date: 07-08-2016 Through 12-08-2016",

}

Gkatzia, D, Lemon, O & Rieser, V 2016, Natural Language Generation enhances human decision-making with uncertain information. in Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics. vol. 2, Association for Computational Linguistics, pp. 264-268, 54th Annual Meeting of the Association for Computational Linguistics 2016, Berlin, Germany, 7/08/16. https://doi.org/10.18653/v1/P16-2043

Natural Language Generation enhances human decision-making with uncertain information. / Gkatzia, Dimitra; Lemon, Oliver ; Rieser, Verena.
Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics. Vol. 2 Association for Computational Linguistics, 2016. p. 264-268.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - Natural Language Generation enhances human decision-making with uncertain information

AU - Gkatzia, Dimitra

AU - Lemon, Oliver

AU - Rieser, Verena

PY - 2016

Y1 - 2016

N2 - Decision-making is often dependent on uncertain data, e.g. data associated with confidence scores or probabilities. We present a comparison of different information presentations for uncertain data and,for the first time, measure their effects on human decision-making. We show that the use of Natural Language Generation (NLG) improves decision-making under uncertainty, compared to state-of-the art graphical-based representation methods.In a task-based study with 442 adults,we found that presentations using NLG lead to 24% better decision-making on average than the graphical presentations, and to 44% better decision-making when NLG is combined with graphics. We also show that women achieve significantly better results when presented with NLG output(an 87% increase on average compared to graphical presentations).

AB - Decision-making is often dependent on uncertain data, e.g. data associated with confidence scores or probabilities. We present a comparison of different information presentations for uncertain data and,for the first time, measure their effects on human decision-making. We show that the use of Natural Language Generation (NLG) improves decision-making under uncertainty, compared to state-of-the art graphical-based representation methods.In a task-based study with 442 adults,we found that presentations using NLG lead to 24% better decision-making on average than the graphical presentations, and to 44% better decision-making when NLG is combined with graphics. We also show that women achieve significantly better results when presented with NLG output(an 87% increase on average compared to graphical presentations).

U2 - 10.18653/v1/P16-2043

DO - 10.18653/v1/P16-2043

M3 - Conference contribution

SN - 9781945626012

VL - 2

SP - 264

EP - 268

BT - Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics

PB - Association for Computational Linguistics

T2 - 54th Annual Meeting of the Association for Computational Linguistics 2016

Y2 - 7 August 2016 through 12 August 2016

ER -

Natural Language Generation enhances human decision-making with uncertain information

Abstract

Conference

Access to Document

Fingerprint

Datasets

The extended WeatherGame

Profiles

Verena Rieser

Cite this