MMLForge Search models, datasets, tasks… Start free
Home › Models › Fill Mask › deepmind/language-perceiver
L

deepmind/language-perceiver

Fill Mask·deepmind· 105.8K· 21
transformers apache-2.0 Fill Mask 201.1M params dataset:wikipediadataset:c4arxiv:1810.04805arxiv:2107.14795arxiv:2004.03720

Perceiver IO model pre-trained on the Masked Language Modeling (MLM) task proposed in BERT using a large text corpus obtained by combining English Wikipedia and C4. It was introduced in the paper Perceiver IO: A General Architecture for Structured Inputs & Outputs by Jaegle et al. and first released in this repository.

Open in MLForge Sign up free Desktop app Source ↗
# pull & run locally
pip install mlforge-sdk && mlforge pull deepmind/language-perceiver

Model details

Task
Fill Mask
Provider
deepmind
Framework
transformers
Parameters
201.1M
Size
3.0 GB
License
apache-2.0
Downloads
105.8K
Likes
21
Paper
arXiv:1810.04805
Updated
2024-04-11

About deepmind/language-perceiver

Perceiver IO model pre-trained on the Masked Language Modeling (MLM) task proposed in BERT using a large text corpus obtained by combining English Wikipedia and C4. It was introduced in the paper Perceiver IO: A General Architecture for Structured Inputs & Outputs by Jaegle et al. and first released in this repository.

Related Fill Mask

B google-bert/bert-base-uncased Fill Mask ·110.1M params 75.4M 2.7K 🤗 HF X FacebookAI/xlm-roberta-base Fill Mask ·278.9M params 21.1M 853 🤗 HF R FacebookAI/roberta-base Fill Mask ·124.7M params 11.9M 617 🤗 HF R FacebookAI/roberta-large Fill Mask ·355.4M params 11.5M 301 🤗 HF M answerdotai/ModernBERT-base Fill Mask ·149.7M params 9.4M 1.1K 🤗 HF D distilbert/distilbert-base-uncased Fill Mask ·67.0M params 8.9M 901 🤗 HF

Browse all Fill Mask models →