TabFact

Dataset Information
Modalities
Texts
Introduced
2019
License
CC BY 4.0
Homepage
Official Website
Contents

Overview

TabFact is a large-scale dataset which consists of 117,854 manually annotated statements with regard to 16,573 Wikipedia tables, their relations are classified as ENTAILED and REFUTED. TabFact is the first dataset to evaluate language inference on structured data, which involves mixed reasoning skills in both symbolic and linguistic aspects.

Source: GitHub

Variants: TabFact

Associated Benchmarks

This dataset is used in 2 benchmarks:

Recent Benchmark Submissions

Task Model Paper Date
Table-based Fact Verification ARTEMIS-DA ARTEMIS-DA: An Advanced Reasoning and … 2024-12-18
Table-based Fact Verification NormTab (Targeted) + SQL NormTab: Improving Symbolic Reasoning in … 2024-06-25
Table-based Fact Verification Tab-PoT Efficient Prompting for LLM-based Generative … 2024-06-14
Table-based Fact Verification TabSQLify (col+row) TabSQLify: Enhancing Reasoning Capabilities of … 2024-04-15
Natural Language Inference ChatGPT 3.5 SpatialFormat LAPDoc: Layout-Aware Prompting for Documents 2024-02-15
Table-based Fact Verification Chain-of-Table Chain-of-Table: Evolving Tables in the … 2024-01-09
Table-based Fact Verification Dater Large Language Models are Versatile … 2023-01-31
Table-based Fact Verification PASTA PASTA: Table-Operations Aware Fact Verification … 2022-11-05
Table-based Fact Verification ReasTAP-Large ReasTAP: Injecting Table Reasoning Skills … 2022-10-22
Table-based Fact Verification Binder Binding Language Models in Symbolic … 2022-10-06
Table-based Fact Verification T5-3b(UnifiedSKG) UnifiedSKG: Unifying and Multi-Tasking Structured … 2022-01-16
Table-based Fact Verification Salience-aware TAPAS Table-based Fact Verification with Salience-aware … 2021-09-09
Table-based Fact Verification TAPEX-Large TAPEX: Table Pre-training via Learning … 2021-07-16
Table-based Fact Verification TAPAS-Large classifier with Counterfactual + Synthetic pre-training Understanding tables with intermediate pre-training 2020-10-01
Table-based Fact Verification Table-BERT-Horizontal-T+F-Template TabFact: A Large-scale Dataset for … 2019-09-05
Table-based Fact Verification BERT classifier w/o Table TabFact: A Large-scale Dataset for … 2019-09-05

Research Papers

Recent papers with results on this dataset:

External Links: