MMLForge Search models, datasets, tasks… Start free
Home › Models › Summarization › google/bigbird-pegasus-large-pubmed
B

google/bigbird-pegasus-large-pubmed

Summarization·google· 1.3K· 47
transformers apache-2.0 Summarization dataset:scientific_papersarxiv:2007.14062license:apache-2.0deploy:azure

BigBird, is a sparse-attention based transformer which extends Transformer based models, such as BERT to much longer sequences. Moreover, BigBird comes along with a theoretical understanding of the capabilities of a complete transformer that the sparse model can handle.

Open in MLForge Sign up free Desktop app Source ↗
# pull & run locally
pip install mlforge-sdk && mlforge pull google/bigbird-pegasus-large-pubmed

Model details

Task
Summarization
Provider
google
Framework
transformers
Size
4.3 GB
License
apache-2.0
Downloads
1.3K
Likes
47
Paper
arXiv:2007.14062
Updated
2023-01-24

About google/bigbird-pegasus-large-pubmed

BigBird, is a sparse-attention based transformer which extends Transformer based models, such as BERT to much longer sequences. Moreover, BigBird comes along with a theoretical understanding of the capabilities of a complete transformer that the sparse model can handle.

Related Summarization

B facebook/bart-large-cnn Summarization ·406.3M params 1.6M 1.6K 🤗 HF D sshleifer/distilbart-cnn-12-6 Summarization 842.6K 322 🤗 HF P google/pegasus-xsum Summarization 241.9K 222 🤗 HF B philschmid/bart-large-cnn-samsum Summarization 144.8K 268 🤗 HF F human-centered-summarization/financial-summarization-pegasus Summarization ·568.8M params 137.4K 144 🤗 HF D sshleifer/distilbart-xsum-12-6 Summarization 99.5K 7 🤗 HF

Browse all Summarization models →