Sberbank Question Answering Dataset
A large scale analogue of Stanford SQuAD in the Russian language - is a valuable resource that has not been properly presented to the scientific community.
Source: SberQuAD -- Russian Reading Comprehension Dataset: Description and Analysis
See DeepPavlov link
| Model config | EM (dev) | F-1 (dev) |
|---|---|---|
| DeepPavlov RuBERT | 66.30+-0.24 | 84.60+-0.11 |
| DeepPavlov multilingual BERT | 64.35+-0.39 | 83.39+-0.08 |
| DeepPavlov R-Net | 60.62 | 80.04 |
Variants: SberQuAD
This dataset is used in 1 benchmark:
| Task | Model | Paper | Date |
|---|---|---|---|
| Question Answering | DeepPavlov RuBERT | SberQuAD -- Russian Reading Comprehension … | 2019-12-20 |
| Question Answering | DeepPavlov multilingual BERT | SberQuAD -- Russian Reading Comprehension … | 2019-12-20 |
| Question Answering | DeepPavlov R-Net | SberQuAD -- Russian Reading Comprehension … | 2019-12-20 |
Recent papers with results on this dataset: