Abstract
Voice assistant accessibility is generally overlooked as today's spoken dialogue systems are trained on huge corpora to help them understand the 'average' user. This raises frustrating barriers for certain user groups as their speech shifts from the average. People with dementia pause more frequently mid-sentence for example, and people with hearing impairments may mispronounce words learned post-diagnosis. We explore whether semantic parsing can improve accessibility for people with nonstandard speech, and consequently become more robust to external disruptions like dogs barking, sirens passing, or doors slamming mid-utterance. We generate corpora of disrupted sentences paired with their underspecified Abstract Meaning Representation (AMR) graphs, and use these to train pipelines to understand and repair disruptions. Our best disruption recovery pipeline lost only 1.6% graph similarity f-score when compared to a model given the full original sentence.
Original language | English |
---|---|
Title of host publication | Proceedings of the Annual Conference of the International Speech Communication Association |
Publisher | ISCA |
Pages | 1224-1228 |
Number of pages | 5 |
DOIs | |
Publication status | Published - 2023 |
Event | 24th International Speech Communication Association Conference 2023 - Dublin, Ireland Duration: 20 Aug 2023 → 24 Aug 2023 https://interspeech2023.org/ |
Conference
Conference | 24th International Speech Communication Association Conference 2023 |
---|---|
Abbreviated title | INTERSPEECH 2023 |
Country/Territory | Ireland |
City | Dublin |
Period | 20/08/23 → 24/08/23 |
Internet address |
Keywords
- accessibility
- human-computer interaction
- semantic parsing
- spoken dialogue systems
ASJC Scopus subject areas
- Language and Linguistics
- Human-Computer Interaction
- Signal Processing
- Software
- Modelling and Simulation