ML Research Wiki / Benchmarks / AMR Parsing / LDC2017T10

LDC2017T10

AMR Parsing Benchmark

Performance Over Time

📊 Showing 23 results | 📏 Metric: Smatch

Top Performing Models

Rank Model Paper Smatch Date Code
1 StructBART + MBSE (IBM) 📚 Maximum Bayes Smatch Ensemble Distillation for AMR Parsing 86.70 2021-12-14 📦 IBM/transition-amr-parser 📦 ibm/amr-annotations 📦 pournaki/transition-amr-parser
2 Graphene Smatch (IBM) 📚 Ensembling Graph Predictions for AMR Parsing 86.26 2021-10-18 📦 ibm/graph_ensemble_learning
3 LeakDistill 📚 Incorporating Graph Information in Transformer-based AMR Parsing 86.10 2023-06-23 📦 sapienzanlp/leakdistill
4 StructBART + MBSE (IBM) 📚 Maximum Bayes Smatch Ensemble Distillation for AMR Parsing 85.90 2021-12-14 📦 IBM/transition-amr-parser 📦 ibm/amr-annotations 📦 pournaki/transition-amr-parser
5 Graphene Support (IBM) 📚 Ensembling Graph Predictions for AMR Parsing 85.85 2021-10-18 📦 ibm/graph_ensemble_learning
6 AMRBART large 📚 Graph Pre-training for AMR Parsing and Generation 85.40 2022-03-15 📦 muyeby/amrbart 📦 goodbai-nlp/amrbart
7 ATP-SRL (Ensemble) 📚 ATP: AMRize Then Parse! Enhancing AMR Parsing with PseudoAMRs 85.30 2022-04-19 📦 chenllliang/atp 📦 pkunlp-icler/atp
8 ATP-SRL 📚 ATP: AMRize Then Parse! Enhancing AMR Parsing with PseudoAMRs 85.20 2022-04-19 📦 chenllliang/atp 📦 pkunlp-icler/atp
9 StructBART-J (IBM) 📚 Structure-aware Fine-tuning of Sequence-to-sequence Transformers for Transition-based AMR Parsing 84.70 2021-10-29 📦 IBM/transition-amr-parser
10 LeakDistill (base) 📚 Incorporating Graph Information in Transformer-based AMR Parsing 84.70 2023-06-23 📦 sapienzanlp/leakdistill

All Papers (23)