ML Research Wiki / Benchmarks / Semantic Textual Similarity / MTEB

MTEB

Semantic Textual Similarity Benchmark

Performance Over Time

📊 Showing 30 results | 📏 Metric: Spearman Correlation

Top Performing Models

Rank Model Paper Spearman Correlation Date Code
1 AnglE-UAE AnglE-optimized Text Embeddings 84.54 2023-09-22 📦 SeanLee97/AnglE 📦 4ai/bellm
2 ST5-XXL MTEB: Massive Text Embedding Benchmark 82.63 2022-10-13 📦 embeddings-benchmark/mteb 📦 lyon-nlp/mteb-french 📦 climsocana/tecb-de 📦 wadoodabdul/clinical_ner_benchmark 📦 basf/chemteb
3 ST5-Large MTEB: Massive Text Embedding Benchmark 81.83 2022-10-13 📦 embeddings-benchmark/mteb 📦 lyon-nlp/mteb-french 📦 climsocana/tecb-de 📦 wadoodabdul/clinical_ner_benchmark 📦 basf/chemteb
4 ST5-XL MTEB: Massive Text Embedding Benchmark 81.66 2022-10-13 📦 embeddings-benchmark/mteb 📦 lyon-nlp/mteb-french 📦 climsocana/tecb-de 📦 wadoodabdul/clinical_ner_benchmark 📦 basf/chemteb
5 ST5-Base MTEB: Massive Text Embedding Benchmark 81.14 2022-10-13 📦 embeddings-benchmark/mteb 📦 lyon-nlp/mteb-french 📦 climsocana/tecb-de 📦 wadoodabdul/clinical_ner_benchmark 📦 basf/chemteb
6 MPNet-multilingual MTEB: Massive Text Embedding Benchmark 80.73 2022-10-13 📦 embeddings-benchmark/mteb 📦 lyon-nlp/mteb-french 📦 climsocana/tecb-de 📦 wadoodabdul/clinical_ner_benchmark 📦 basf/chemteb
7 SGPT-5.8B-nli MTEB: Massive Text Embedding Benchmark 80.53 2022-10-13 📦 embeddings-benchmark/mteb 📦 lyon-nlp/mteb-french 📦 climsocana/tecb-de 📦 wadoodabdul/clinical_ner_benchmark 📦 basf/chemteb
8 MPNet MTEB: Massive Text Embedding Benchmark 80.28 2022-10-13 📦 embeddings-benchmark/mteb 📦 lyon-nlp/mteb-french 📦 climsocana/tecb-de 📦 wadoodabdul/clinical_ner_benchmark 📦 basf/chemteb
9 MiniLM-L12 MTEB: Massive Text Embedding Benchmark 79.80 2022-10-13 📦 embeddings-benchmark/mteb 📦 lyon-nlp/mteb-french 📦 climsocana/tecb-de 📦 wadoodabdul/clinical_ner_benchmark 📦 basf/chemteb
10 SimCSE-BERT-sup MTEB: Massive Text Embedding Benchmark 79.12 2022-10-13 📦 embeddings-benchmark/mteb 📦 lyon-nlp/mteb-french 📦 climsocana/tecb-de 📦 wadoodabdul/clinical_ner_benchmark 📦 basf/chemteb

All Papers (30)

SeanLee97/AnglE 4ai/bellm
embeddings-benchmark/mteb lyon-nlp/mteb-french
embeddings-benchmark/mteb lyon-nlp/mteb-french
embeddings-benchmark/mteb lyon-nlp/mteb-french
embeddings-benchmark/mteb lyon-nlp/mteb-french
embeddings-benchmark/mteb lyon-nlp/mteb-french
embeddings-benchmark/mteb lyon-nlp/mteb-french
embeddings-benchmark/mteb lyon-nlp/mteb-french
embeddings-benchmark/mteb lyon-nlp/mteb-french
embeddings-benchmark/mteb lyon-nlp/mteb-french
embeddings-benchmark/mteb lyon-nlp/mteb-french
embeddings-benchmark/mteb lyon-nlp/mteb-french
embeddings-benchmark/mteb lyon-nlp/mteb-french
embeddings-benchmark/mteb lyon-nlp/mteb-french
embeddings-benchmark/mteb lyon-nlp/mteb-french
embeddings-benchmark/mteb lyon-nlp/mteb-french

MTEB: Massive Text Embedding Benchmark

2022
SGPT-BLOOM-7.1B-msmarco
embeddings-benchmark/mteb lyon-nlp/mteb-french
embeddings-benchmark/mteb lyon-nlp/mteb-french
embeddings-benchmark/mteb lyon-nlp/mteb-french
embeddings-benchmark/mteb lyon-nlp/mteb-french
embeddings-benchmark/mteb lyon-nlp/mteb-french
embeddings-benchmark/mteb lyon-nlp/mteb-french
embeddings-benchmark/mteb lyon-nlp/mteb-french
embeddings-benchmark/mteb lyon-nlp/mteb-french
embeddings-benchmark/mteb lyon-nlp/mteb-french
embeddings-benchmark/mteb lyon-nlp/mteb-french
embeddings-benchmark/mteb lyon-nlp/mteb-french
embeddings-benchmark/mteb lyon-nlp/mteb-french
embeddings-benchmark/mteb lyon-nlp/mteb-french
embeddings-benchmark/mteb lyon-nlp/mteb-french