Results of the Quality Estimation Shared Task 2021

Note: in each table, the "Rank" column indicates the averaged ranking of participants with regards to all metrics (including memory print and number of parameters).

Task 1 -- Sentence-level Direct Assessment

(top)

Multilingual
English-German	English-Chinese
Romanian-English	Estonian-English
Nepalese-English	Sinhala-English
Russian-English

-- Zero-shot language pairs:

English-Czech	English-Japanese
Pashto-English	Khmer-English

Task 2 -- Sentence-level Post-Editing Effort

(top)

Multilingual
English-German	English-Chinese
Romanian-English	Estonian-English
Nepalese-English	Sinhala-English
Russian-English

-- Zero-shot language pairs:

English-Czech	English-Japanese
Pashto-English	Khmer-English

Task 2 -- Word-level Post-Editing Effort

(top)

Multilingual

Words in MT	GAPs in MT
Words in SRC

English-German

(top)

Words in MT	GAPs in MT
Words in SRC

English-Chinese

(top)

Words in MT	GAPs in MT
Words in SRC

Romanian-English

(top)

Words in MT	GAPs in MT
Words in SRC

Estonian-English

(top)

Words in MT	GAPs in MT
Words in SRC

Nepalse-English

(top)

Words in MT	GAPs in MT
Words in SRC

Sinhala-English

(top)

Words in MT	GAPs in MT
Words in SRC

Russian-English

(top)

Words in MT	GAPs in MT
Words in SRC

English-Czech

(top)

Words in MT	GAPs in MT
Words in SRC

English-Japanese

(top)

Words in MT	GAPs in MT
Words in SRC

Pashto-English

(top)

Words in MT	GAPs in MT
Words in SRC

Khmer-English

(top)

Words in MT	GAPs in MT
Words in SRC