ML Research Wiki / Benchmarks / Code Generation / WikiSQL

WikiSQL

Code Generation Benchmark

Performance Over Time

📊 Showing 10 results | 📏 Metric: Execution Accuracy

Top Performing Models

Rank Model Paper Execution Accuracy Date Code
1 NL2SQL-RULE Content Enhanced BERT-based Text-to-SQL Generation 89.20 2019-10-16 📦 guotong1988/NL2SQL-RULE 📦 guotong1988/NL2SQL-BERT 📦 shivam017arora/Conversational-BI 📦 yangyucheng000/University 📦 realsonalkumar/Mish-Mash-Hackathon
2 TypeSQL+TC (Yu et al., 2018)+ TypeSQL: Knowledge-based Type-Aware Neural Text-to-SQL Generation 82.60 2018-04-25 📦 taoyds/typesql
3 Tranx TRANX: A Transition-based Neural Abstract Syntax Parser for Semantic Parsing and Code Generation 78.60 2018-10-05 📦 pcyin/tranX 📦 DeepLearnXMU/CG-RL 📦 yuxiang2/CoNaLa 📦 Pro-v-7/code-generation
4 STAMP+RL (Sun et al., 2018)+ Semantic Parsing with Syntax- and Table-Aware SQL Generation 74.60 2018-04-23 -
5 STAMP (Sun et al., 2018)+ Semantic Parsing with Syntax- and Table-Aware SQL Generation 74.40 2018-04-23 -
6 TypeSQL (Yu et al., 2018) TypeSQL: Knowledge-based Type-Aware Neural Text-to-SQL Generation 73.50 2018-04-25 📦 taoyds/typesql
7 PT-MAML (Huang et al., 2018) Natural Language to Structured Query Generation via Meta-Learning 68.00 2018-03-02 📦 Microsoft/PointerSQL
8 Bidirectional Attention for SQL Generation Bidirectional Attention for SQL Generation 62.50 2017-12-30 📦 guotong1988/NL2SQL 📦 openbotai/nl2sql
9 Seq2SQL (Zhong et al., 2017) Seq2SQL: Generating Structured Queries from Natural Language using Reinforcement Learning 59.40 2017-08-31 📦 salesforce/WikiSQL 📦 xiaojunxu/SQLNet 📦 tiwarikajal/Seq2SQL-
10 Seq2Seq (Zhong et al., 2017) Seq2SQL: Generating Structured Queries from Natural Language using Reinforcement Learning 35.90 2017-08-31 📦 salesforce/WikiSQL 📦 xiaojunxu/SQLNet 📦 tiwarikajal/Seq2SQL-

All Papers (10)

guotong1988/NL2SQL-RULE guotong1988/NL2SQL-BERT
taoyds/typesql
pcyin/tranX DeepLearnXMU/CG-RL
taoyds/typesql
Microsoft/PointerSQL

Bidirectional Attention for SQL Generation

2017
Bidirectional Attention for SQL Generation
guotong1988/NL2SQL openbotai/nl2sql
salesforce/WikiSQL xiaojunxu/SQLNet
salesforce/WikiSQL xiaojunxu/SQLNet