Results and Collected Judgments
August 8 - 9, 2013
Sofia, Bulgaria
[HOME]
| [TRANSLATION TASK]
| [METRICS TASK]
| [QUALITY ESTIMATION TASK]
| [SCHEDULE]
| [PAPERS]
| [AUTHORS]
| [RESULTS]
The results of the shared task are summarized in the paper:
-
Findings of the 2013 Workshop on Statistical Machine Translation
Ondřej Bojar, Christian Buck, Chris Callison-Burch, Christian Federmann, Barry Haddow, Philipp Koehn, Christof Monz, Matt Post, Radu Soricut and Lucia Specia
pdf
bib
The raw data is available for download here:
- All system submissions, source files, and reference files for all tasks/systems, in both plain text and SGM (56 MB).
- Human judgments (and
documentation) collected during the manual evaluation, for all the
system ranking tasks (2.0 MB).
- English-Czech monolingual post-edits (blind-edits) and their revisions, including a brief documentation. This package also contains the additional Czech references, as described in the overview paper. (470 kB)
- Metrics Task data, including metrics submissions and all scripts to reproduce the results published in the metrics task paper (114 MB).
- Quality Estimation task: submissions, baseline and gold-standard for sentence-level subtask 1.1, sentence-level subtask 1.2, sentence-level subtask 1.3 and word-level subtask.
You can also download the raw data from WMT07, WMT08, WMT09, WMT10, WMT11, and WMT12.
Supported by the European Commision
under the
project (grant number 288487)