PIQA

Physical Interaction: Question Answering

Dataset Information
Modalities
Texts
Introduced
2019
License
Unknown
Homepage

Overview

PIQA is a dataset for commonsense reasoning, and was created to investigate the physical knowledge of existing models in NLP.

Source: PIQA

Variants: PIQA

Associated Benchmarks

This dataset is used in 2 benchmarks:

Recent Benchmark Submissions

Task Model Paper Date
Question Answering Shakti-LLM (2.5B) SHAKTI: A 2.5 Billion Parameter … 2024-10-15
Question Answering LLaMA3 8B+MoSLoRA Mixture-of-Subspaces in Low-Rank Adaptation 2024-06-16
Question Answering LLaMA-3 8B + MixLoRA MixLoRA: Enhancing Large Language Models … 2024-04-22
Question Answering LLaMA-2 13B + MixLoRA MixLoRA: Enhancing Large Language Models … 2024-04-22
Question Answering LLaMA-2 7B + MixLoRA MixLoRA: Enhancing Large Language Models … 2024-04-22
Question Answering Mixtral 8x7B (0-shot) Mixtral of Experts 2024-01-08
Question Answering Mistral 7B (0-shot) Mixtral of Experts 2024-01-08
Question Answering Camelidae-8×34B Parameter-Efficient Sparsity Crafting from Dense … 2024-01-05
Question Answering Sheared-LLaMA-2.7B Sheared LLaMA: Accelerating Language Model … 2023-10-10
Question Answering Sheared-LLaMA-1.3B Sheared LLaMA: Accelerating Language Model … 2023-10-10
Question Answering Open-LLaMA-3B-v2 Sheared LLaMA: Accelerating Language Model … 2023-10-10
Question Answering Mistral 7B (0-shot) Mistral 7B 2023-10-10
Question Answering phi-1.5-web (1.3B) Textbooks Are All You Need … 2023-09-11
Question Answering LLaMA 2 7B (0-shot) Llama 2: Open Foundation and … 2023-07-18
Question Answering LLaMA 2 70B (0-shot) Llama 2: Open Foundation and … 2023-07-18
Question Answering LLaMA 2 34B (0-shot) Llama 2: Open Foundation and … 2023-07-18
Question Answering LLaMA 2 13B (0-shot) Llama 2: Open Foundation and … 2023-07-18
Question Answering PaLM 2-M (1-shot) PaLM 2 Technical Report 2023-05-17
Question Answering PaLM 2-L (1-shot) PaLM 2 Technical Report 2023-05-17
Question Answering PaLM 2-S (1-shot) PaLM 2 Technical Report 2023-05-17

Research Papers

Recent papers with results on this dataset: