ML Research Wiki / Benchmarks / Code Generation / WebApp1K-React

WebApp1K-React

Code Generation Benchmark

Performance Over Time

📊 Showing 8 results | 📏 Metric: pass@1

Top Performing Models

Rank Model Paper pass@1 Date Code
1 o1-preview A Case Study of Web App Coding with OpenAI Reasoning Models 0.95 2024-09-19 📦 onekq/webapp1k
2 o1-mini A Case Study of Web App Coding with OpenAI Reasoning Models 0.94 2024-09-19 📦 onekq/webapp1k
3 gpt-4o-2024-08-06 Insights from Benchmarking Frontier Language Models on Web App Code Generation 0.89 2024-09-08 📦 onekq/webapp1k
4 claude-3.5-sonnet Insights from Benchmarking Frontier Language Models on Web App Code Generation 0.88 2024-09-08 📦 onekq/webapp1k
5 deepseek-v2.5 A Case Study of Web App Coding with OpenAI Reasoning Models 0.83 2024-09-19 📦 onekq/webapp1k
6 mistral-large-2 Insights from Benchmarking Frontier Language Models on Web App Code Generation 0.78 2024-09-08 📦 onekq/webapp1k
7 deepseek-coder-v2-instruct Insights from Benchmarking Frontier Language Models on Web App Code Generation 0.70 2024-09-08 📦 onekq/webapp1k
8 llama-v3p1-405b-instruct Insights from Benchmarking Frontier Language Models on Web App Code Generation 0.30 2024-09-08 📦 onekq/webapp1k

All Papers (8)

onekq/webapp1k
onekq/webapp1k
onekq/webapp1k
onekq/webapp1k
onekq/webapp1k
onekq/webapp1k
onekq/webapp1k
onekq/webapp1k