📊 Showing 6 results | 📏 Metric: Average F1
| Rank | Model | Paper | Average F1 | Date | Code |
|---|---|---|---|---|---|
| 1 | Human Benchmark | RussianSuperGLUE: A Russian Language Understanding Evaluation Benchmark | 0.70 | 2020-10-29 | 📦 RussianNLP/RussianSuperGLUE 📦 RussianNLP/MOROCCO |
| 2 | majority_class | Unreasonable Effectiveness of Rule-Based Heuristics in Solving Russian SuperGLUE Tasks | 0.48 | 2021-05-03 | - |
| 3 | MT5 Large | mT5: A massively multilingual pre-trained text-to-text transformer | 0.45 | 2020-10-22 | 📦 huggingface/transformers 📦 google-research/multilingual-t5 📦 google-research/byt5 |
| 4 | Baseline TF-IDF1.1 | RussianSuperGLUE: A Russian Language Understanding Evaluation Benchmark | 0.44 | 2020-10-29 | 📦 RussianNLP/RussianSuperGLUE 📦 RussianNLP/MOROCCO |
| 5 | heuristic majority | Unreasonable Effectiveness of Rule-Based Heuristics in Solving Russian SuperGLUE Tasks | 0.44 | 2021-05-03 | - |
| 6 | Random weighted | Unreasonable Effectiveness of Rule-Based Heuristics in Solving Russian SuperGLUE Tasks | 0.37 | 2021-05-03 | - |