ML Research Wiki / Benchmarks / Code Generation / CoNaLa-Ext

CoNaLa-Ext

Code Generation Benchmark

Performance Over Time

📊 Showing 5 results | 📏 Metric: BLEU

Top Performing Models

Rank Model Paper BLEU Date Code
1 BART W/ Mined Reading StackOverflow Encourages Cheating: Adding Question Text Improves Extractive Code Generation 35.32 2021-06-08 📦 gabeorlanski/stackoverflow-encourages-cheating
2 BART Base Reading StackOverflow Encourages Cheating: Adding Question Text Improves Extractive Code Generation 34.35 2021-06-08 📦 gabeorlanski/stackoverflow-encourages-cheating
3 External Knowledge With API + Reranking Incorporating External Knowledge through Pre-training for Natural Language to Code Generation 20.54 2020-04-20 📦 neulab/external-knowledge-codegen 📦 zorazrw/multilingual-conala
4 External Knowledge With API Incorporating External Knowledge through Pre-training for Natural Language to Code Generation 20.37 2020-04-20 📦 neulab/external-knowledge-codegen 📦 zorazrw/multilingual-conala
5 TranX TRANX: A Transition-based Neural Abstract Syntax Parser for Semantic Parsing and Code Generation 18.85 2018-10-05 📦 pcyin/tranX 📦 DeepLearnXMU/CG-RL 📦 yuxiang2/CoNaLa 📦 Pro-v-7/code-generation

All Papers (5)

gabeorlanski/stackoverflow-encourages-cheating
gabeorlanski/stackoverflow-encourages-cheating
neulab/external-knowledge-codegen zorazrw/multilingual-conala
neulab/external-knowledge-codegen zorazrw/multilingual-conala
pcyin/tranX DeepLearnXMU/CG-RL