A systematic review of reproducibility research in natural language processing

Anya Belz, Shubham Agarwal, Anastasia Shimorina, Ehud Reiter

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Against the background of what has been termed a reproducibility crisis in science, the NLP field is becoming increasingly interested in, and conscientious about, the reproducibility of its results. The past few years have seen an impressive range of new initiatives, events and active research in the area. However, the field is far from reaching a consensus about how reproducibility should be defined, measured and addressed, with diversity of views currently increasing rather than converging. With this focused contribution, we aim to provide a wide-angle, and as near as possible complete, snapshot of current work on reproducibility in NLP, delineating differences and similarities, and providing pointers to common denominators.

Original languageEnglish
Title of host publicationProceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics
PublisherAssociation for Computational Linguistics
Pages381-393
Number of pages13
ISBN (Electronic)9781954085022
Publication statusPublished - Apr 2021
Event16th Conference of the European Chapter of the Associationfor Computational Linguistics 2021 - Virtual, Online
Duration: 19 Apr 202123 Apr 2021

Conference

Conference16th Conference of the European Chapter of the Associationfor Computational Linguistics 2021
Abbreviated titleEACL 2021
CityVirtual, Online
Period19/04/2123/04/21

ASJC Scopus subject areas

  • Software
  • Computational Theory and Mathematics
  • Linguistics and Language

Fingerprint

Dive into the research topics of 'A systematic review of reproducibility research in natural language processing'. Together they form a unique fingerprint.

Cite this