ML Research Wiki / Benchmarks / Code Documentation Generation / CodeSearchNet

CodeSearchNet

Code Documentation Generation Benchmark

Performance Over Time

📊 Showing 7 results | 📏 Metric: Smoothed BLEU-4

Top Performing Models

Rank Model Paper Smoothed BLEU-4 Date Code
1 CodeBERT (MLM+RTD) CodeBERT: A Pre-Trained Model for Programming and Natural Languages 15.99 2020-02-19 📦 salesforce/codet5 📦 microsoft/CodeBERT 📦 graykode/commit-autosuggestions
2 CodeBERT (MLM) CodeBERT: A Pre-Trained Model for Programming and Natural Languages 15.55 2020-02-19 📦 salesforce/codet5 📦 microsoft/CodeBERT 📦 graykode/commit-autosuggestions
3 pre-train w/ code only CodeBERT: A Pre-Trained Model for Programming and Natural Languages 15.15 2020-02-19 📦 salesforce/codet5 📦 microsoft/CodeBERT 📦 graykode/commit-autosuggestions
4 CodeBERT (RTD) CodeBERT: A Pre-Trained Model for Programming and Natural Languages 15.03 2020-02-19 📦 salesforce/codet5 📦 microsoft/CodeBERT 📦 graykode/commit-autosuggestions
5 RoBERTa CodeBERT: A Pre-Trained Model for Programming and Natural Languages 14.52 2020-02-19 📦 salesforce/codet5 📦 microsoft/CodeBERT 📦 graykode/commit-autosuggestions
6 Transformer CodeBERT: A Pre-Trained Model for Programming and Natural Languages 14.31 2020-02-19 📦 salesforce/codet5 📦 microsoft/CodeBERT 📦 graykode/commit-autosuggestions
7 seq2seq CodeBERT: A Pre-Trained Model for Programming and Natural Languages 13.36 2020-02-19 📦 salesforce/codet5 📦 microsoft/CodeBERT 📦 graykode/commit-autosuggestions

All Papers (7)