Abstract
Regression testing of natural language systems is problematic for two main reasons: component input and output is complex, and system behaviour is context-dependent. We have developed a generic approach which solves both of these issues. We describe our regression tool, Contest, which supports context-dependent testing of dialogue system components, and discuss the regression test sets we developed, designed to effectively isolate components from changes and problems earlier in the pipeline. We believe that the same approach can be used in regression testing for other dialogue systems, as well as in testing any complex NLP system containing multiple components.
| Original language | English |
|---|---|
| Title of host publication | Proceedings of the Workshop on Software Engineering, Testing, and Quality Assurance for Natural Language Processing |
| Editors | P.G.T Healey, R. Pieraccini, D. Byron, S. Young, M. Purver |
| Place of Publication | Stroudsburg, PA, USA |
| Publisher | Association for Computational Linguistics |
| Pages | 5-13 |
| Number of pages | 9 |
| ISBN (Electronic) | 978-1-932432-32-9 |
| Publication status | Published - Jun 2009 |
| Event | NAACL-HLT 2009 North American Chapter of the Association for Computational Linguistics - Human Language Technologies Conference - Boulder, Colorado, United States Duration: 31 May 2009 → 5 Jun 2009 |
Conference
| Conference | NAACL-HLT 2009 North American Chapter of the Association for Computational Linguistics - Human Language Technologies Conference |
|---|---|
| Country/Territory | United States |
| City | Boulder, Colorado |
| Period | 31/05/09 → 5/06/09 |