ML Research Wiki / Benchmarks / Text Summarization / Pubmed

Pubmed

Text Summarization Benchmark

Performance Over Time

📊 Showing 28 results | 📏 Metric: ROUGE-1

Top Performing Models

Rank Model Paper ROUGE-1 Date Code
1 BART-LS Adapting Pretrained Text-to-Text Models for Long Text Sequences 50.30 2022-09-21 📦 facebookresearch/bart_ls
2 DeepPyramidion Sparsifying Transformer Models with Trainable Representation Pooling 47.81 2020-09-10 📦 applicaai/pyramidions
3 LongT5 LongT5: Efficient Text-To-Text Transformer for Long Sequences 46.67 2021-12-15 📦 google-research/longt5 📦 utsjiyaoli/qa-attack 📦 pwc-1/Paper-9 📦 MindSpore-scientific-2/code-14
4 Top Down Transformer (AdaPool) (464M) Long Document Summarization with Top-down and Bottom-up Inference 46.47 2022-03-15 📦 lllyasviel/framepack
5 eyeglaxs Scaling Up Summarization: Leveraging Large Language Models for Long Text Extractive Summarization 45.96 2024-08-28 -
6 GoSum (extractive) GoSum: Extractive Summarization of Long Documents by Reinforcement Learning and Graph Organized discourse state 45.10 2022-11-18 📦 Eulring/GoSum
7 PEGASUS 📚 PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarization 45.09 2019-12-18 📦 huggingface/transformers 📦 google-research/pegasus 📦 google-research/longt5
8 Sent-CLF On Extractive and Abstractive Neural Document Summarization with Transformer Language Models 45.01 2019-09-07 📦 Bread-and-Code/Text-Summarization
9 Lodoss-full-large (extractive) Toward Unifying Text Segmentation and Long Document Summarization 44.84 2022-10-28 📦 tencent-ailab/lodoss
10 ExtSum-LG Extractive Summarization of Long Documents by Combining Global and Local Context 44.81 2019-09-17 📦 Wendy-Xiao/Extsumm_local_global_context

All Papers (28)