ML Research Wiki / Benchmarks / Semantic Textual Similarity / SICK

SICK

Semantic Textual Similarity Benchmark

Performance Over Time

📊 Showing 22 results | 📏 Metric: Spearman Correlation

Top Performing Models

Rank	Model	Paper	Spearman Correlation	Date	Code
1	PromCSE-RoBERTa-large (0.355B)	Improved Universal Sentence Embeddings with Prompt-based Contrastive Learning and Energy-based Learning	0.82	2022-03-14	📦 yjiangcm/promcse
2	PromptEOL+CSE+LLaMA-30B	Scaling Sentence Embeddings with Large Language Models	0.82	2023-07-31	📦 kongds/scaling_sentemb
3	PromptEOL+CSE+OPT-13B	Scaling Sentence Embeddings with Large Language Models	0.82	2023-07-31	📦 kongds/scaling_sentemb
4	SimCSE-RoBERTalarge	SimCSE: Simple Contrastive Learning of Sentence Embeddings	0.82	2021-04-18	📦 PaddlePaddle/PaddleNLP 📦 princeton-nlp/SimCSE 📦 mcgill-nlp/llm2vec
5	PromptEOL+CSE+OPT-2.7B	Scaling Sentence Embeddings with Large Language Models	0.81	2023-07-31	📦 kongds/scaling_sentemb
6	SentenceBERT 📚	Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks	0.75	2019-08-27	📦 UKPLab/sentence-transformers 📦 PaddlePaddle/PaddleNLP 📦 princeton-nlp/SimCSE
7	SRoBERTa-NLI-base	Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks	0.74	2019-08-27	📦 UKPLab/sentence-transformers 📦 PaddlePaddle/PaddleNLP 📦 princeton-nlp/SimCSE
8	SRoBERTa-NLI-large	Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks	0.74	2019-08-27	📦 UKPLab/sentence-transformers 📦 PaddlePaddle/PaddleNLP 📦 princeton-nlp/SimCSE
9	Dino (STS/̄🦕)	Generating Datasets with Pretrained Language Models	0.74	2021-04-15	📦 timoschick/dino 📦 yipingnus/scratchplot-story-generation
10	SBERT-NLI-large	Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks	0.74	2019-08-27	📦 UKPLab/sentence-transformers 📦 PaddlePaddle/PaddleNLP 📦 princeton-nlp/SimCSE

All Papers (22)

Improved Universal Sentence Embeddings with Prompt-based Contrastive Learning and Energy-based Learning

2022

PromCSE-RoBERTa-large (0.355B)

yjiangcm/promcse

Scaling Sentence Embeddings with Large Language Models

2023

PromptEOL+CSE+LLaMA-30B

kongds/scaling_sentemb

Scaling Sentence Embeddings with Large Language Models

2023

PromptEOL+CSE+OPT-13B

kongds/scaling_sentemb

SimCSE: Simple Contrastive Learning of Sentence Embeddings

2021

SimCSE-RoBERTalarge

PaddlePaddle/PaddleNLP princeton-nlp/SimCSE

Scaling Sentence Embeddings with Large Language Models

2023

PromptEOL+CSE+OPT-2.7B

kongds/scaling_sentemb

Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks

2019

SentenceBERT

UKPLab/sentence-transformers PaddlePaddle/PaddleNLP

Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks

2019

SRoBERTa-NLI-base

UKPLab/sentence-transformers PaddlePaddle/PaddleNLP

Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks

2019

SRoBERTa-NLI-large

UKPLab/sentence-transformers PaddlePaddle/PaddleNLP

Generating Datasets with Pretrained Language Models

2021

Dino (STS/̄🦕)

timoschick/dino yipingnus/scratchplot-story-generation

Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks

2019

SBERT-NLI-large

UKPLab/sentence-transformers PaddlePaddle/PaddleNLP

Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks

2019

SBERT-NLI-base

UKPLab/sentence-transformers PaddlePaddle/PaddleNLP

Trans-Encoder: Unsupervised sentence-pair modelling through self- and mutual-distillations

2021

Trans-Encoder-BERT-base-bi (unsup.)

amzn/trans-encoder

Trans-Encoder: Unsupervised sentence-pair modelling through self- and mutual-distillations

2021

Trans-Encoder-BERT-large-cross (unsup.)

amzn/trans-encoder

Trans-Encoder: Unsupervised sentence-pair modelling through self- and mutual-distillations

2021

Trans-Encoder-RoBERTa-large-cross (unsup.)

amzn/trans-encoder

Trans-Encoder: Unsupervised sentence-pair modelling through self- and mutual-distillations

2021

Trans-Encoder-BERT-large-bi (unsup.)

amzn/trans-encoder

Fast, Effective, and Self-Supervised: Transforming Masked Language Models into Universal Lexical and Sentence Encoders

2021

Mirror-RoBERTa-base (unsup.)

cambridgeltl/mirror-bert

Fast, Effective, and Self-Supervised: Transforming Masked Language Models into Universal Lexical and Sentence Encoders

2021

Mirror-BERT-base (unsup.)

cambridgeltl/mirror-bert

Trans-Encoder: Unsupervised sentence-pair modelling through self- and mutual-distillations

2021

Trans-Encoder-BERT-base-cross (unsup.)

amzn/trans-encoder

Generating Datasets with Pretrained Language Models

2021

Dino (STSb/̄🦕)

timoschick/dino yipingnus/scratchplot-story-generation

Rematch: Robust and Efficient Matching of Local Knowledge Graphs to Improve Structural and Semantic Similarity

2024

Rematch

osome-iu/Rematch-RARE

On the Sentence Embeddings from Pre-trained Language Models

2020

BERTbase-flow (NLI)

InsaneLife/dssm bohanli/BERT-flow sleepthroughdifficulties/kernelwhitening

An Unsupervised Sentence Embedding Method by Mutual Information Maximization

2020

IS-BERT-NLI

yanzhangnlp/IS-BERT

SICK

Performance Over Time

Edit Benchmark Results

Edit Result

Top Performing Models

All Papers (22)

Improved Universal Sentence Embeddings with Prompt-based Contrastive Learning and Energy-based Learning

Scaling Sentence Embeddings with Large Language Models

Scaling Sentence Embeddings with Large Language Models

SimCSE: Simple Contrastive Learning of Sentence Embeddings

Scaling Sentence Embeddings with Large Language Models

Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks

Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks

Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks

Generating Datasets with Pretrained Language Models

Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks

Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks

Trans-Encoder: Unsupervised sentence-pair modelling through self- and mutual-distillations

Trans-Encoder: Unsupervised sentence-pair modelling through self- and mutual-distillations

Trans-Encoder: Unsupervised sentence-pair modelling through self- and mutual-distillations

Trans-Encoder: Unsupervised sentence-pair modelling through self- and mutual-distillations

Fast, Effective, and Self-Supervised: Transforming Masked Language Models into Universal Lexical and Sentence Encoders

Fast, Effective, and Self-Supervised: Transforming Masked Language Models into Universal Lexical and Sentence Encoders

Trans-Encoder: Unsupervised sentence-pair modelling through self- and mutual-distillations

Generating Datasets with Pretrained Language Models

Rematch: Robust and Efficient Matching of Local Knowledge Graphs to Improve Structural and Semantic Similarity

On the Sentence Embeddings from Pre-trained Language Models

An Unsupervised Sentence Embedding Method by Mutual Information Maximization

Model	Paper	Spearman Correlation	Date
PromCSE-RoBERTa-large (0.355B)	Improved Universal Sentence Embeddings with Promp…	0.82	2022-03-14
PromptEOL+CSE+LLaMA-30B	Scaling Sentence Embeddings with Large Language M…	0.82	2023-07-31
PromptEOL+CSE+OPT-13B	Scaling Sentence Embeddings with Large Language M…	0.82	2023-07-31
SimCSE-RoBERTalarge	SimCSE: Simple Contrastive Learning of Sentence E…	0.82	2021-04-18
PromptEOL+CSE+OPT-2.7B	Scaling Sentence Embeddings with Large Language M…	0.81	2023-07-31
SentenceBERT	Sentence-BERT: Sentence Embeddings using Siamese …	0.75	2019-08-27
SRoBERTa-NLI-base	Sentence-BERT: Sentence Embeddings using Siamese …	0.74	2019-08-27
SRoBERTa-NLI-large	Sentence-BERT: Sentence Embeddings using Siamese …	0.74	2019-08-27
Dino (STS/̄🦕)	Generating Datasets with Pretrained Language Mode…	0.74	2021-04-15
SBERT-NLI-large	Sentence-BERT: Sentence Embeddings using Siamese …	0.74	2019-08-27
SBERT-NLI-base	Sentence-BERT: Sentence Embeddings using Siamese …	0.73	2019-08-27
Trans-Encoder-BERT-base-bi (unsup.)	Trans-Encoder: Unsupervised sentence-pair modelli…	0.73	2021-09-27
Trans-Encoder-BERT-large-cross (unsup.)	Trans-Encoder: Unsupervised sentence-pair modelli…	0.72	2021-09-27
Trans-Encoder-RoBERTa-large-cross (unsup.)	Trans-Encoder: Unsupervised sentence-pair modelli…	0.72	2021-09-27
Trans-Encoder-BERT-large-bi (unsup.)	Trans-Encoder: Unsupervised sentence-pair modelli…	0.71	2021-09-27
Mirror-RoBERTa-base (unsup.)	Fast, Effective, and Self-Supervised: Transformin…	0.71	2021-04-16
Mirror-BERT-base (unsup.)	Fast, Effective, and Self-Supervised: Transformin…	0.70	2021-04-16
Trans-Encoder-BERT-base-cross (unsup.)	Trans-Encoder: Unsupervised sentence-pair modelli…	0.70	2021-09-27
Dino (STSb/̄🦕)	Generating Datasets with Pretrained Language Mode…	0.68	2021-04-15
Rematch	Rematch: Robust and Efficient Matching of Local K…	0.68	2024-04-02
BERTbase-flow (NLI)	On the Sentence Embeddings from Pre-trained Langu…	0.65	2020-11-02
IS-BERT-NLI	An Unsupervised Sentence Embedding Method by Mutu…	0.64	2020-09-25