ML Research Wiki / Benchmarks / Identify Odd Metapor / BIG-bench

BIG-bench

Identify Odd Metapor Benchmark

Performance Over Time

📊 Showing 2 results | 📏 Metric: Accuracy

Click "Edit" next to any result to modify it, or add a new result at the bottom. All changes will be reviewed before going live.

Yellow rows = Pending edits Green rows = Pending new results

Model	Paper	Accuracy	Date	Actions
Chinchilla-70B (few-shot, k=5)	Training Compute-Optimal Large Language Models	68.80	2022-03-29
Gopher-280B (few-shot, k=5)	Scaling Language Models: Methods, Analysis & Insi…	38.60	2021-12-08

Rank	Model	Paper	Accuracy	Date	Code
1	Chinchilla-70B (few-shot, k=5)	Training Compute-Optimal Large Language Models	68.80	2022-03-29	📦 karpathy/llama2.c 📦 nkluge-correa/teenytinyllama
2	Gopher-280B (few-shot, k=5)	Scaling Language Models: Methods, Analysis & Insights from Training Gopher	38.60	2021-12-08	📦 allenai/dolma 📦 rvlopes/gloria 📦 bramiozo/PubScience

2022

Chinchilla-70B (few-shot, k=5)

karpathy/llama2.c nkluge-correa/teenytinyllama

2021

Gopher-280B (few-shot, k=5)

allenai/dolma rvlopes/gloria bramiozo/PubScience