ML Research Wiki / Benchmarks / Code Generation / Verified Smart Contract Code Comments

Verified Smart Contract Code Comments

Code Generation Benchmark

Performance Over Time

📊 Showing 2 results | 📏 Metric: BLEU score

Click "Edit" next to any result to modify it, or add a new result at the bottom. All changes will be reviewed before going live.

Yellow rows = Pending edits Green rows = Pending new results

Model	Paper	BLEU score	Date	Actions
GPT-J 6B Smart Contract	Efficient Avoidance of Vulnerabilities in Auto-co…	55.70	2023-09-18
GPT-J 6B	Efficient Avoidance of Vulnerabilities in Auto-co…	25.80	2023-09-18

Rank	Model	Paper	BLEU score	Date	Code
1	GPT-J 6B Smart Contract	Efficient Avoidance of Vulnerabilities in Auto-completed Smart Contract Code Using Vulnerability-constrained Decoding	55.70	2023-09-18	-
2	GPT-J 6B	Efficient Avoidance of Vulnerabilities in Auto-completed Smart Contract Code Using Vulnerability-constrained Decoding	25.80	2023-09-18	-

2023

GPT-J 6B Smart Contract

2023

GPT-J 6B