EmoStory: Emotion Prediction and Mapping in Narrative Stories

Seng Wei Too, John See, Albert Quek, Hui Ngo Goh*

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

66 Downloads (Pure)

Abstract

A well-designed story is built upon a sequence of plots and events. Each event has its purpose in piquing the audience's interest in the plot; thus, understanding the flow of emotions within the story is vital to its success. A story is usually built up through dramatic changes in emotion and mood to create resonance with the audience. The lack of research in this understudied field warrants exploring several aspects of the emotional analysis of stories. In this paper, we propose an encoder-decoder framework to perform sentence-level emotion recognition of narrative stories on both dimensional and categorical aspects, achieving MAE=0.0846 and 54% accuracy (8-class), respectively, on the EmoTales dataset and a reasonably good level of generalization to an untrained dataset. The first use of attention and multi-head attention mechanisms for emotion representation mapping (ERM) yields state-of-the-art performance in certain settings. We further present the preliminary idea of EmoStory, a concept that seamlessly predicts both dimensional and categorical space in an efficient manner, made possible with ERM. This methodology is useful in only one of the two aspects is available. In the future, these techniques could be extended to model the personality or emotional state of characters in stories, which could benefit the affective assessment of experiences and the creation of emotive avatars and virtual worlds.

Original languageEnglish
Pages (from-to)2048-2055
Number of pages8
JournalInternational Journal on Informatics Visualization
Volume7
Issue number3-2
DOIs
Publication statusPublished - 30 Nov 2023

Keywords

  • affective computing
  • Deep learning
  • natural language processing

ASJC Scopus subject areas

  • General Computer Science
  • Statistics, Probability and Uncertainty
  • Information Systems and Management

Fingerprint

Dive into the research topics of 'EmoStory: Emotion Prediction and Mapping in Narrative Stories'. Together they form a unique fingerprint.

Cite this