ML Research Wiki / Benchmarks / Natural Language Inference / SciTail

SciTail

Natural Language Inference Benchmark

Performance Over Time

📊 Showing 11 results | 📏 Metric: Accuracy

Top Performing Models

Rank Model Paper Accuracy Date Code
1 CA-MTL Conditionally Adaptive Multi-Task Learning: Improving Transfer Learning in NLP Using Fewer Parameters & Less Data 96.80 2020-09-19 📦 CAMTL/CA-MTL
2 MT-DNN-SMARTLARGEv0 SMART: Robust and Efficient Fine-Tuning for Pre-trained Natural Language Models through Principled Regularized Optimization 96.60 2019-11-08 📦 namisan/mt-dnn 📦 microsoft/MT-DNN 📦 archinetai/smart-pytorch
3 MT-DNN-SMART_100%ofTrainingData SMART: Robust and Efficient Fine-Tuning for Pre-trained Natural Language Models through Principled Regularized Optimization 96.10 2019-11-08 📦 namisan/mt-dnn 📦 microsoft/MT-DNN 📦 archinetai/smart-pytorch
4 MT-DNN Multi-Task Deep Neural Networks for Natural Language Understanding 94.10 2019-01-31 📦 namisan/mt-dnn 📦 xycforgithub/MultiTask-MRC 📦 ABaldrati/MT-BERT
5 MT-DNN-SMART_10%ofTrainingData SMART: Robust and Efficient Fine-Tuning for Pre-trained Natural Language Models through Principled Regularized Optimization 91.30 2019-11-08 📦 namisan/mt-dnn 📦 microsoft/MT-DNN 📦 archinetai/smart-pytorch
6 MT-DNN-SMART_1%ofTrainingData SMART: Robust and Efficient Fine-Tuning for Pre-trained Natural Language Models through Principled Regularized Optimization 88.60 2019-11-08 📦 namisan/mt-dnn 📦 microsoft/MT-DNN 📦 archinetai/smart-pytorch
7 Hierarchical BiLSTM Max Pooling Sentence Embeddings in NLI with Iterative Refinement Encoders 86.00 2018-08-27 📦 Helsinki-NLP/HBMP
8 RE2 Simple and Effective Text Matching with Richer Alignment Features 86.00 2019-08-01 📦 alibaba-edu/simple-effective-text-matching 📦 hitvoice/RE2 📦 alibaba-edu/simple-effective-text-matching-pytorch
9 CAFE Compare, Compress and Propagate: Enhancing Neural Architectures with Alignment Factorization for Natural Language Inference 83.30 2017-12-30 -
10 MT-DNN-SMART_0.1%ofTrainingData SMART: Robust and Efficient Fine-Tuning for Pre-trained Natural Language Models through Principled Regularized Optimization 82.30 2019-11-08 📦 namisan/mt-dnn 📦 microsoft/MT-DNN 📦 archinetai/smart-pytorch

All Papers (11)

CAMTL/CA-MTL
namisan/mt-dnn microsoft/MT-DNN
namisan/mt-dnn microsoft/MT-DNN
namisan/mt-dnn xycforgithub/MultiTask-MRC
namisan/mt-dnn microsoft/MT-DNN
namisan/mt-dnn microsoft/MT-DNN
Helsinki-NLP/HBMP
alibaba-edu/simple-effective-text-matching hitvoice/RE2 alibaba-edu/simple-effective-text-matching-pytorch
namisan/mt-dnn microsoft/MT-DNN
Div290/SplitEE