ML Research Wiki / Benchmarks / Question Answering / QuAC

QuAC

Question Answering Benchmark

Performance Over Time

📊 Showing 2 results | 📏 Metric: F1

Click "Edit" next to any result to modify it, or add a new result at the bottom. All changes will be reviewed before going live.

Yellow rows = Pending edits Green rows = Pending new results

Model	Paper	F1	Date	Actions
FlowQA (single model)	FlowQA: Grasping Flow in History for Conversation…	64.10	2018-10-06
GPT-3 175B (few-shot, k=32)	Language Models are Few-Shot Learners	44.30	2020-05-28

Rank	Model	Paper	F1	Date	Code
1	FlowQA (single model)	FlowQA: Grasping Flow in History for Conversational Machine Comprehension	64.10	2018-10-06	📦 momohuang/FlowQA
2	GPT-3 175B (few-shot, k=32)	Language Models are Few-Shot Learners	44.30	2020-05-28	📦 ggml-org/llama.cpp 📦 ggerganov/llama.cpp 📦 karpathy/llm.c

2018

FlowQA (single model)

momohuang/FlowQA

2020

GPT-3 175B (few-shot, k=32)

ggml-org/llama.cpp ggerganov/llama.cpp