In the last two years we have seen impressive results for reference-free metrics such as COMET-QE [Rei et al. 2021] and OpenKiwi [Kepler et al, 2019].
This year the QE shared task will also rely on MQM data and for that reason we encourage participants from the QE shared task to participate in the metrics task simultaneously!
The testsets and analysis performed in this subtask will differ from the ones in the QE shared task but we believe that a well tuned QE system can function as a Metric.
The dates for the QE as a metric subtask are exactly the same as the main Metrics task.
| Date | |
|---|---|
| System outputs ready to download | 16th August, 2022 |
| Submission deadline for metrics task | 23th August, 2022❗ |
| Paper submission deadline to WMT | 7th September, 2022 |
| WMT Notification of acceptance | 9th October, 2022 |
| WMT Camera-ready deadline | 16th October, 2022 |
| Conference | 7th - 8th December, 2022 |