Choice of Plausible Alternatives
The Choice Of Plausible Alternatives (COPA) evaluation provides researchers with a tool for assessing progress in open-domain commonsense causal reasoning. COPA consists of 1000 questions, split equally into development and test sets of 500 questions each. Each question is composed of a premise and two alternatives, where the task is to select the alternative that more plausibly has a causal relation with the premise. The correct alternative is randomized so that the expected performance of randomly guessing is 50%.
Source: Choice of Plausible Alternatives (COPA)
Image Source: https://people.ict.usc.edu/~gordon/copa.html
Variants: COPA
This dataset is used in 1 benchmark:
Recent papers with results on this dataset: