DotPrompts is a set of testcases derived from PragmaticCode, such that each testcase consists of a prompt to a dereference location (a code location having the "." operator in Java). It is primarily meant as a benchmark for Code LMs.
Variants: DotPrompts
This dataset is used in 1 benchmark:
Task | Model | Paper | Date |
---|---|---|---|
Code Completion | SantaCoder-MGD | Guiding Language Models of Code … | 2023-06-19 |
Code Completion | SantaCoder | Guiding Language Models of Code … | 2023-06-19 |
Recent papers with results on this dataset: