MMLForge Search models, datasets, tasks… Start free
Home › Models › Summarization › google/bigbird-pegasus-large-arxiv
B

google/bigbird-pegasus-large-arxiv

Summarization·google· 4.6K· 65
transformers apache-2.0 Summarization dataset:scientific_papersarxiv:2007.14062license:apache-2.0deploy:azure

BigBird, is a sparse-attention based transformer which extends Transformer based models, such as BERT to much longer sequences. Moreover, BigBird comes along with a theoretical understanding of the capabilities of a complete transformer that the sparse model can handle.

Open in MLForge Sign up free Desktop app Source ↗
# pull & run locally
pip install mlforge-sdk && mlforge pull google/bigbird-pegasus-large-arxiv

Model details

Task
Summarization
Provider
google
Framework
transformers
Size
4.3 GB
License
apache-2.0
Downloads
4.6K
Likes
65
Paper
arXiv:2007.14062
Updated
2023-01-24

About google/bigbird-pegasus-large-arxiv

BigBird, is a sparse-attention based transformer which extends Transformer based models, such as BERT to much longer sequences. Moreover, BigBird comes along with a theoretical understanding of the capabilities of a complete transformer that the sparse model can handle.

Related Summarization

B facebook/bart-large-cnn Summarization ·406.3M params 1.6M 1.6K 🤗 HF D sshleifer/distilbart-cnn-12-6 Summarization 842.6K 322 🤗 HF P google/pegasus-xsum Summarization 241.9K 222 🤗 HF B philschmid/bart-large-cnn-samsum Summarization 144.8K 268 🤗 HF F human-centered-summarization/financial-summarization-pegasus Summarization ·568.8M params 137.4K 144 🤗 HF D sshleifer/distilbart-xsum-12-6 Summarization 99.5K 7 🤗 HF

Browse all Summarization models →