ML Research Wiki / Benchmarks / Machine Translation / ACES

ACES

Machine Translation Benchmark

Performance Over Time

📊 Showing 21 results | 📏 Metric: Score

Top Performing Models

Rank	Model	Paper	Score	Date	Code
1	HWTSC-Teacher-Sim	ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics	19.97	2022-10-27	📦 edinburghnlp/aces
2	MS-COMET-22	ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics	19.89	2022-10-27	📦 edinburghnlp/aces
3	MS-COMET-QE-22	ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics	19.76	2022-10-27	📦 edinburghnlp/aces
4	KG-BERTScore	ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics	17.28	2022-10-27	📦 edinburghnlp/aces
5	metricx_xl_DA_2019	ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics	17.17	2022-10-27	📦 edinburghnlp/aces
6	COMET-QE	ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics	16.80	2022-10-27	📦 edinburghnlp/aces
7	COMET-22	ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics	16.31	2022-10-27	📦 edinburghnlp/aces
8	UniTE-src	ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics	15.68	2022-10-27	📦 edinburghnlp/aces
9	UniTE-ref	ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics	15.38	2022-10-27	📦 edinburghnlp/aces
10	metricx_xxl_DA_2019	ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics	15.24	2022-10-27	📦 edinburghnlp/aces

All Papers (21)

ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics

2022

HWTSC-Teacher-Sim

edinburghnlp/aces

ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics

2022

MS-COMET-22

edinburghnlp/aces

ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics

2022

MS-COMET-QE-22

edinburghnlp/aces

ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics

2022

KG-BERTScore

edinburghnlp/aces

ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics

2022

metricx_xl_DA_2019

edinburghnlp/aces

ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics

2022

COMET-QE

edinburghnlp/aces

ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics

2022

COMET-22

edinburghnlp/aces

ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics

2022

UniTE-src

edinburghnlp/aces

ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics

2022

UniTE-ref

edinburghnlp/aces

ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics

2022

metricx_xxl_DA_2019

edinburghnlp/aces

ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics

2022

UniTE

edinburghnlp/aces

ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics

2022

Cross-QE

edinburghnlp/aces

ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics

2022

chrF

edinburghnlp/aces

ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics

2022

metricx_xl_MQM_2020

edinburghnlp/aces

ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics

2022

COMET-20

edinburghnlp/aces

ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics

2022

BLEURT-20

edinburghnlp/aces

ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics

2022

YiSi-1

edinburghnlp/aces

ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics

2022

BERTScore

edinburghnlp/aces

ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics

2022

f200spBLEU

edinburghnlp/aces

ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics

2022

f101spBLEU

edinburghnlp/aces

ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics

2022

BLEU

edinburghnlp/aces

ACES

Performance Over Time

Edit Benchmark Results

Edit Result

Top Performing Models

All Papers (21)

ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics

ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics

ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics

ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics

ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics

ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics

ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics

ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics

ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics

ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics

ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics

ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics

ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics

ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics

ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics

ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics

ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics

ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics

ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics

ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics

ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics

Model	Paper	Score	Date
HWTSC-Teacher-Sim	ACES: Translation Accuracy Challenge Sets for Eva…	19.97	2022-10-27
MS-COMET-22	ACES: Translation Accuracy Challenge Sets for Eva…	19.89	2022-10-27
MS-COMET-QE-22	ACES: Translation Accuracy Challenge Sets for Eva…	19.76	2022-10-27
KG-BERTScore	ACES: Translation Accuracy Challenge Sets for Eva…	17.28	2022-10-27
metricx_xl_DA_2019	ACES: Translation Accuracy Challenge Sets for Eva…	17.17	2022-10-27
COMET-QE	ACES: Translation Accuracy Challenge Sets for Eva…	16.80	2022-10-27
COMET-22	ACES: Translation Accuracy Challenge Sets for Eva…	16.31	2022-10-27
UniTE-src	ACES: Translation Accuracy Challenge Sets for Eva…	15.68	2022-10-27
UniTE-ref	ACES: Translation Accuracy Challenge Sets for Eva…	15.38	2022-10-27
metricx_xxl_DA_2019	ACES: Translation Accuracy Challenge Sets for Eva…	15.24	2022-10-27
UniTE	ACES: Translation Accuracy Challenge Sets for Eva…	14.76	2022-10-27
Cross-QE	ACES: Translation Accuracy Challenge Sets for Eva…	14.07	2022-10-27
chrF	ACES: Translation Accuracy Challenge Sets for Eva…	13.57	2022-10-27
metricx_xl_MQM_2020	ACES: Translation Accuracy Challenge Sets for Eva…	13.08	2022-10-27
COMET-20	ACES: Translation Accuracy Challenge Sets for Eva…	12.06	2022-10-27
BLEURT-20	ACES: Translation Accuracy Challenge Sets for Eva…	11.90	2022-10-27
YiSi-1	ACES: Translation Accuracy Challenge Sets for Eva…	11.38	2022-10-27
BERTScore	ACES: Translation Accuracy Challenge Sets for Eva…	10.47	2022-10-27
f200spBLEU	ACES: Translation Accuracy Challenge Sets for Eva…	-0.18	2022-10-27
f101spBLEU	ACES: Translation Accuracy Challenge Sets for Eva…	-0.33	2022-10-27
BLEU	ACES: Translation Accuracy Challenge Sets for Eva…	-3.13	2022-10-27