ML Research Wiki / Benchmarks / Representation Learning / SciDocs

SciDocs

Representation Learning Benchmark

Performance Over Time

📊 Showing 7 results | 📏 Metric: Avg.

Top Performing Models

Rank Model Paper Avg. Date Code
1 SciNCL Neighborhood Contrastive Learning for Scientific Document Representations with Citation Embeddings 81.80 2022-02-14 📦 malteos/scincl
2 SPECTER SPECTER: Document-level Representation Learning using Citation-informed Transformers 80.00 2020-04-15 📦 allenai/specter 📦 allenai/scidocs 📦 allenai/aspire 📦 sntcristian/and-kge 📦 hle027/IR-Competition
3 Citeomatic SPECTER: Document-level Representation Learning using Citation-informed Transformers 76.00 2020-04-15 📦 allenai/specter 📦 allenai/scidocs 📦 allenai/aspire 📦 sntcristian/and-kge 📦 hle027/IR-Competition
4 Sci-DeCLUTR Neighborhood Contrastive Learning for Scientific Document Representations with Citation Embeddings 66.60 2022-02-14 📦 malteos/scincl
5 SciBERT SPECTER: Document-level Representation Learning using Citation-informed Transformers 59.60 2020-04-15 📦 allenai/specter 📦 allenai/scidocs 📦 allenai/aspire 📦 sntcristian/and-kge 📦 hle027/IR-Competition
6 BioBERT BioBERT: a pre-trained biomedical language representation model for biomedical text mining 58.80 2019-01-25 📦 dmis-lab/biobert 📦 EmilyAlsentzer/clinicalBERT 📦 naver/biobert-pretrained
7 CiteBERT Neighborhood Contrastive Learning for Scientific Document Representations with Citation Embeddings 58.80 2022-02-14 📦 malteos/scincl

All Papers (7)