SQL-Eval is an open-source PostgreSQL evaluation dataset released by Defog, constructed based on Spider. The original link can be found at https://github.com/defog-ai/sql-eval.
Our evaluation methodology is more stringent, as it compares the execution accuracy of the predicted SQL queries against the sole ground truth SQL query.
Variants: SQL-Eval
This dataset is used in 1 benchmark:
Task | Model | Paper | Date |
---|---|---|---|
Text-To-SQL | XiYan-SQL | A Preview of XiYan-SQL: A … | 2024-11-13 |
Recent papers with results on this dataset: