ML Research Wiki / Benchmarks / Text Summarization / MTEB

MTEB

Text Summarization Benchmark

Performance Over Time

📊 Showing 26 results | 📏 Metric: Spearman Correlation

Top Performing Models

Rank Model Paper Spearman Correlation Date Code
1 MPNet-multilingual MTEB: Massive Text Embedding Benchmark 31.57 2022-10-13 📦 embeddings-benchmark/mteb 📦 lyon-nlp/mteb-french 📦 climsocana/tecb-de 📦 wadoodabdul/clinical_ner_benchmark 📦 basf/chemteb
2 ST5-Base MTEB: Massive Text Embedding Benchmark 31.39 2022-10-13 📦 embeddings-benchmark/mteb 📦 lyon-nlp/mteb-french 📦 climsocana/tecb-de 📦 wadoodabdul/clinical_ner_benchmark 📦 basf/chemteb
3 SimCSE-BERT-unsup MTEB: Massive Text Embedding Benchmark 31.15 2022-10-13 📦 embeddings-benchmark/mteb 📦 lyon-nlp/mteb-french 📦 climsocana/tecb-de 📦 wadoodabdul/clinical_ner_benchmark 📦 basf/chemteb
4 MiniLM-L6 MTEB: Massive Text Embedding Benchmark 30.81 2022-10-13 📦 embeddings-benchmark/mteb 📦 lyon-nlp/mteb-french 📦 climsocana/tecb-de 📦 wadoodabdul/clinical_ner_benchmark 📦 basf/chemteb
5 MiniLM-L12-multilingual MTEB: Massive Text Embedding Benchmark 30.67 2022-10-13 📦 embeddings-benchmark/mteb 📦 lyon-nlp/mteb-french 📦 climsocana/tecb-de 📦 wadoodabdul/clinical_ner_benchmark 📦 basf/chemteb
6 GTR-XXL MTEB: Massive Text Embedding Benchmark 30.64 2022-10-13 📦 embeddings-benchmark/mteb 📦 lyon-nlp/mteb-french 📦 climsocana/tecb-de 📦 wadoodabdul/clinical_ner_benchmark 📦 basf/chemteb
7 Komninos MTEB: Massive Text Embedding Benchmark 30.49 2022-10-13 📦 embeddings-benchmark/mteb 📦 lyon-nlp/mteb-french 📦 climsocana/tecb-de 📦 wadoodabdul/clinical_ner_benchmark 📦 basf/chemteb
8 Contriever MTEB: Massive Text Embedding Benchmark 30.36 2022-10-13 📦 embeddings-benchmark/mteb 📦 lyon-nlp/mteb-french 📦 climsocana/tecb-de 📦 wadoodabdul/clinical_ner_benchmark 📦 basf/chemteb
9 SGPT-125M-nli MTEB: Massive Text Embedding Benchmark 30.26 2022-10-13 📦 embeddings-benchmark/mteb 📦 lyon-nlp/mteb-french 📦 climsocana/tecb-de 📦 wadoodabdul/clinical_ner_benchmark 📦 basf/chemteb
10 GTR-XL MTEB: Massive Text Embedding Benchmark 30.21 2022-10-13 📦 embeddings-benchmark/mteb 📦 lyon-nlp/mteb-french 📦 climsocana/tecb-de 📦 wadoodabdul/clinical_ner_benchmark 📦 basf/chemteb

All Papers (26)

embeddings-benchmark/mteb lyon-nlp/mteb-french
embeddings-benchmark/mteb lyon-nlp/mteb-french
embeddings-benchmark/mteb lyon-nlp/mteb-french
embeddings-benchmark/mteb lyon-nlp/mteb-french

MTEB: Massive Text Embedding Benchmark

2022
MiniLM-L12-multilingual
embeddings-benchmark/mteb lyon-nlp/mteb-french
embeddings-benchmark/mteb lyon-nlp/mteb-french
embeddings-benchmark/mteb lyon-nlp/mteb-french
embeddings-benchmark/mteb lyon-nlp/mteb-french
embeddings-benchmark/mteb lyon-nlp/mteb-french
embeddings-benchmark/mteb lyon-nlp/mteb-french
embeddings-benchmark/mteb lyon-nlp/mteb-french
embeddings-benchmark/mteb lyon-nlp/mteb-french
embeddings-benchmark/mteb lyon-nlp/mteb-french
embeddings-benchmark/mteb lyon-nlp/mteb-french
embeddings-benchmark/mteb lyon-nlp/mteb-french
embeddings-benchmark/mteb lyon-nlp/mteb-french
embeddings-benchmark/mteb lyon-nlp/mteb-french
embeddings-benchmark/mteb lyon-nlp/mteb-french
embeddings-benchmark/mteb lyon-nlp/mteb-french
embeddings-benchmark/mteb lyon-nlp/mteb-french
embeddings-benchmark/mteb lyon-nlp/mteb-french
embeddings-benchmark/mteb lyon-nlp/mteb-french
embeddings-benchmark/mteb lyon-nlp/mteb-french

MTEB: Massive Text Embedding Benchmark

2022
SGPT-BLOOM-7.1B-msmarco
embeddings-benchmark/mteb lyon-nlp/mteb-french
embeddings-benchmark/mteb lyon-nlp/mteb-french
embeddings-benchmark/mteb lyon-nlp/mteb-french