Two sides of the same coin : assessing translation quality in two steps through adequacy and acceptability error analysis

Publication type
P1
Publication status
Published
Authors
Daems, J, Macken, L., & Vandepitte, S.
Series
LREC 2014 - NINTH INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION
Pagination
2-2
Conference
9th International Conference on Language Resources and Evaluation (LREC) (Reykjavik, Iceland)
Download
(.pdf)
View in Biblio
(externe link)

Abstract

We propose facilitating the error annotation task of translation quality assessment by introducing an annotation process which consists of two separate steps that are similar to the ones required in the European Standard for translation companies EN 15038: an error analysis for errors relating to acceptability (where the target text as a whole is taken into account, as well as the target text in context), and one for errors relating to adequacy (where source segments are compared to target segments). We present a fine-grained error taxonomy suitable for a diagnostic and comparative analysis of machine translated texts, post-edited texts and human translations. Categories missing in existing metrics have been added, such as lexical issues, coherence issues, and text type-specific issues.