ML Research Wiki / Benchmarks / Dependency Parsing / Penn Treebank

Penn Treebank

Dependency Parsing Benchmark

Performance Over Time

📊 Showing 19 results | 📏 Metric: LAS

Top Performing Models

Rank	Model	Paper	LAS	Date	Code
1	Label Attention Layer + HPSG + XLNet	Rethinking Self-Attention: Towards Interpretability in Neural Parsing	96.26	2019-11-10	📦 KhalilMrini/LAL-Parser 📦 kh8fb/LAL-Parser-Server
2	ACE	Automated Concatenation of Embeddings for Structured Prediction	95.80	2020-10-10	📦 Alibaba-NLP/ACE 📦 zhaoyuesun/phee
3	Deep Biaffine + RoBERTa	Deep Biaffine Attention for Neural Dependency Parsing	95.75	2016-11-06	📦 PaddlePaddle/PaddleNLP 📦 dmlc/gluon-nlp 📦 baidu/DDParser
4	HPSG Parser (Joint) + XLNet	Head-Driven Phrase Structure Grammar Parsing on Penn Treebank	95.72	2019-07-05	📦 DoodleJZ/HPSG-Neural-Parser
5	MFVI	Second-Order Neural Dependency Parsing with Message Passing and End-to-End Training	95.34	2020-10-10	📦 wangxinyu0922/Second_Order_Parsing
6	CVT + Multi-Task	Semi-Supervised Sequence Modeling with Cross-View Training	95.02	2018-09-22	📦 tensorflow/models 📦 rezkaaufar/pytorch-cvt
7	RNG Transformer	Recursive Non-Autoregressive Graph-to-Graph Transformer for Dependency Parsing with Iterative Refinement	95.01	2020-03-29	📦 idiap/g2g-transformer
8	SpanRel	Generalizing Natural Language Analysis through Span-relation Representations	94.70	2019-11-10	📦 jzbjyb/SpanRel 📦 neulab/cmu-multinlp 📦 jiachengli1995/jointie
9	CRFPar	Efficient Second-Order TreeCRF for Neural Dependency Parsing	94.49	2020-05-03	📦 yzhangcs/parser 📦 yzhangcs/crfpar
10	Left-to-Right Pointer Network	Left-to-Right Dependency Parsing with Pointer Networks	94.43	2019-03-20	📦 danifg/Left2Right-Pointer-Parser 📦 danifg/SyntacticPointer

All Papers (19)

Rethinking Self-Attention: Towards Interpretability in Neural Parsing

2019

Label Attention Layer + HPSG + XLNet

KhalilMrini/LAL-Parser kh8fb/LAL-Parser-Server

Automated Concatenation of Embeddings for Structured Prediction

2020

ACE

Alibaba-NLP/ACE zhaoyuesun/phee

Deep Biaffine Attention for Neural Dependency Parsing

2016

Deep Biaffine + RoBERTa

PaddlePaddle/PaddleNLP dmlc/gluon-nlp

Head-Driven Phrase Structure Grammar Parsing on Penn Treebank

2019

HPSG Parser (Joint) + XLNet

DoodleJZ/HPSG-Neural-Parser

Second-Order Neural Dependency Parsing with Message Passing and End-to-End Training

2020

MFVI

wangxinyu0922/Second_Order_Parsing

Semi-Supervised Sequence Modeling with Cross-View Training

2018

CVT + Multi-Task

tensorflow/models rezkaaufar/pytorch-cvt

Recursive Non-Autoregressive Graph-to-Graph Transformer for Dependency Parsing with Iterative Refinement

2020

RNG Transformer

idiap/g2g-transformer

Generalizing Natural Language Analysis through Span-relation Representations

2019

SpanRel

jzbjyb/SpanRel neulab/cmu-multinlp jiachengli1995/jointie

Efficient Second-Order TreeCRF for Neural Dependency Parsing

2020

CRFPar

yzhangcs/parser yzhangcs/crfpar

Left-to-Right Dependency Parsing with Pointer Networks

2019

Left-to-Right Pointer Network

danifg/Left2Right-Pointer-Parser danifg/SyntacticPointer

Deep Biaffine Attention for Neural Dependency Parsing

2016

Deep Biaffine

PaddlePaddle/PaddleNLP dmlc/gluon-nlp

Stack-Pointer Networks for Dependency Parsing

2018

Stack-Pointer Network

XuezheMax/NeuroNLP2 ShannonAI/mrc-for-dependency-parsing danifg/SyntacticPointer

An improved neural network model for joint POS tagging and dependency parsing

2018

jPTDP

datquocnguyen/jPTDP

Globally Normalized Transition-Based Neural Networks

2016

Andor et al.

tensorflow/models

Distilling an Ensemble of Greedy Dependency Parsers into One MST Parser

2016

Distilled neural FOG

adhigunasurya/distillation_parser

Structured Training for Neural Network Transition-Based Parsing

2015

Weiss et al.

Simple and Accurate Dependency Parsing Using Bidirectional LSTM Feature Representations

2016

BIST transition-based parser

elikip/bist-parser

Training with Exploration Improves a Greedy Stack-LSTM Parser

2016

Arc-hybrid

Simple and Accurate Dependency Parsing Using Bidirectional LSTM Feature Representations

2016

BIST graph-based parser

elikip/bist-parser

Penn Treebank

Performance Over Time

Edit Benchmark Results

Edit Result

Top Performing Models

All Papers (19)

Rethinking Self-Attention: Towards Interpretability in Neural Parsing

Automated Concatenation of Embeddings for Structured Prediction

Deep Biaffine Attention for Neural Dependency Parsing

Head-Driven Phrase Structure Grammar Parsing on Penn Treebank

Second-Order Neural Dependency Parsing with Message Passing and End-to-End Training

Semi-Supervised Sequence Modeling with Cross-View Training

Recursive Non-Autoregressive Graph-to-Graph Transformer for Dependency Parsing with Iterative Refinement

Generalizing Natural Language Analysis through Span-relation Representations

Efficient Second-Order TreeCRF for Neural Dependency Parsing

Left-to-Right Dependency Parsing with Pointer Networks

Deep Biaffine Attention for Neural Dependency Parsing

Stack-Pointer Networks for Dependency Parsing

An improved neural network model for joint POS tagging and dependency parsing

Globally Normalized Transition-Based Neural Networks

Distilling an Ensemble of Greedy Dependency Parsers into One MST Parser

Structured Training for Neural Network Transition-Based Parsing

Simple and Accurate Dependency Parsing Using Bidirectional LSTM Feature Representations

Training with Exploration Improves a Greedy Stack-LSTM Parser

Simple and Accurate Dependency Parsing Using Bidirectional LSTM Feature Representations

Model	Paper	LAS	Date
Label Attention Layer + HPSG + XLNet	Rethinking Self-Attention: Towards Interpretabili…	96.26	2019-11-10
ACE	Automated Concatenation of Embeddings for Structu…	95.80	2020-10-10
Deep Biaffine + RoBERTa	Deep Biaffine Attention for Neural Dependency Par…	95.75	2016-11-06
HPSG Parser (Joint) + XLNet	Head-Driven Phrase Structure Grammar Parsing on P…	95.72	2019-07-05
MFVI	Second-Order Neural Dependency Parsing with Messa…	95.34	2020-10-10
CVT + Multi-Task	Semi-Supervised Sequence Modeling with Cross-View…	95.02	2018-09-22
RNG Transformer	Recursive Non-Autoregressive Graph-to-Graph Trans…	95.01	2020-03-29
SpanRel	Generalizing Natural Language Analysis through Sp…	94.70	2019-11-10
CRFPar	Efficient Second-Order TreeCRF for Neural Depende…	94.49	2020-05-03
Left-to-Right Pointer Network	Left-to-Right Dependency Parsing with Pointer Net…	94.43	2019-03-20
Deep Biaffine	Deep Biaffine Attention for Neural Dependency Par…	94.22	2016-11-06
Stack-Pointer Network	Stack-Pointer Networks for Dependency Parsing	94.19	2018-05-03
jPTDP	An improved neural network model for joint POS ta…	93.87	2018-07-11
Andor et al.	Globally Normalized Transition-Based Neural Netwo…	92.79	2016-03-19
Distilled neural FOG	Distilling an Ensemble of Greedy Dependency Parse…	92.06	2016-09-24
Weiss et al.	Structured Training for Neural Network Transition…	92.06	2015-06-19
BIST transition-based parser	Simple and Accurate Dependency Parsing Using Bidi…	91.90	2016-03-14
Arc-hybrid	Training with Exploration Improves a Greedy Stack…	91.42	2016-03-11
BIST graph-based parser	Simple and Accurate Dependency Parsing Using Bidi…	91.00	2016-03-14