ML Research Wiki / Benchmarks / Code Completion / DotPrompts

DotPrompts

Code Completion Benchmark

Performance Over Time

📊 Showing 2 results | 📏 Metric: Compilation Rate

Click "Edit" next to any result to modify it, or add a new result at the bottom. All changes will be reviewed before going live.

Yellow rows = Pending edits Green rows = Pending new results

Model	Paper	Compilation Rate	Date	Actions
SantaCoder-MGD	Guiding Language Models of Code with Global Conte…	73.03	2023-06-19
SantaCoder	Guiding Language Models of Code with Global Conte…	59.79	2023-06-19

Rank	Model	Paper	Compilation Rate	Date	Code
1	SantaCoder-MGD	Guiding Language Models of Code with Global Context using Monitors	73.03	2023-06-19	📦 microsoft/monitors4codegen
2	SantaCoder	Guiding Language Models of Code with Global Context using Monitors	59.79	2023-06-19	📦 microsoft/monitors4codegen

2023

SantaCoder-MGD

microsoft/monitors4codegen

2023

SantaCoder

microsoft/monitors4codegen