SNLI

Stanford Natural Language Inference

Dataset Information
Modalities
Texts
Languages
English
Introduced
2015
License
Homepage

Overview

The SNLI dataset (Stanford Natural Language Inference) consists of 570k sentence-pairs manually labeled as entailment, contradiction, and neutral. Premises are image captions from Flickr30k, while hypotheses were generated by crowd-sourced annotators who were shown a premise and asked to generate entailing, contradicting, and neutral sentences. Annotators were instructed to judge the relation between sentences given that they describe the same event. Each pair is labeled as “entailment”, “neutral”, “contradiction” or “-”, where “-” indicates that an agreement could not be reached.

Source: Breaking NLI Systemswith Sentences that Require Simple Lexical Inferences

Variants: SNLI, JSNLI

Associated Benchmarks

This dataset is used in 1 benchmark:

Recent Benchmark Submissions

Task Model Paper Date
Natural Language Inference UnitedSynT5 (335M) First Train to Generate, then … 2024-12-12
Natural Language Inference UnitedSynT5 (3B) First Train to Generate, then … 2024-12-12
Natural Language Inference SplitEE-S SplitEE: Early Exit in Deep … 2023-09-17
Natural Language Inference DEIM DEIM: An effective deep encoding … 2022-03-20
Natural Language Inference Neural Tree Indexers for Text Understanding Entailment as Few-Shot Learner 2021-04-29
Natural Language Inference EFL (Entailment as Few-shot Learner) + RoBERTa-large Entailment as Few-Shot Learner 2021-04-29
Natural Language Inference RoBERTa-large+Self-Explaining Self-Explaining Structures Improve NLP Models 2020-12-03
Natural Language Inference RoBERTa-large + self-explaining layer Self-Explaining Structures Improve NLP Models 2020-12-03
Natural Language Inference CA-MTL Conditionally Adaptive Multi-Task Learning: Improving … 2020-09-19
Natural Language Inference MT-DNN-SMART_0.1%ofTrainingData SMART: Robust and Efficient Fine-Tuning … 2019-11-08
Natural Language Inference MT-DNN-SMART_100%ofTrainingData SMART: Robust and Efficient Fine-Tuning … 2019-11-08
Natural Language Inference MT-DNN-SMARTLARGEv0 SMART: Robust and Efficient Fine-Tuning … 2019-11-08
Natural Language Inference MT-DNN-SMART_1%ofTrainingData SMART: Robust and Efficient Fine-Tuning … 2019-11-08
Natural Language Inference MT-DNN-SMART_10%ofTrainingData SMART: Robust and Efficient Fine-Tuning … 2019-11-08
Natural Language Inference SemBERT Semantics-aware BERT for Language Understanding 2019-09-05
Natural Language Inference DELTA (LSTM) DELTA: A DEep learning based … 2019-08-02
Natural Language Inference RE2 Simple and Effective Text Matching … 2019-08-01
Natural Language Inference 300D DMAN Ensemble Discourse Marker Augmented Network with … 2019-07-23
Natural Language Inference 300D DMAN Discourse Marker Augmented Network with … 2019-07-23
Natural Language Inference Star-Transformer (no cross sentence attention) Star-Transformer 2019-02-25

Research Papers

Recent papers with results on this dataset: