ANLI

Adversarial NLI

Dataset Information
Modalities
Texts
Introduced
2019
License
CC BY-NC 4.0
Homepage
Official Website
Contents

Overview

The Adversarial Natural Language Inference (ANLI, Nie et al.) is a new large-scale NLI benchmark dataset, collected via an iterative, adversarial human-and-model-in-the-loop procedure. Particular, the data is selected to be difficult to the state-of-the-art models, including BERT and RoBERTa.

Source: The Microsoft Toolkit of Multi-Task Deep Neural Networks for Natural Language Understanding
Image Source: https://arxiv.org/pdf/1910.14599.pdf

Variants: ANLI test, ANLI, ANLI-all, ANLI-r3

Associated Benchmarks

This dataset is used in 1 benchmark:

  • Natural Language Inference - Metrics: Accuracy, F1 Macro, F1 Micro, F1 Weighted, Precision Macro, Precision Micro, Precision Weighted, Recall Macro, Recall Micro, Recall Weighted, loss

Recent Benchmark Submissions

No recent benchmark submissions available for this dataset.

Research Papers

No papers with results on this dataset found.

External Links: