MMLForge Search models, datasets, tasks… Start free
Home › Models › Fill Mask › albert/albert-base-v1
A

albert/albert-base-v1

Fill Mask·albert· 115.8K· 13
transformers apache-2.0 Fill Mask 11.8M params dataset:bookcorpusdataset:wikipediaarxiv:1909.11942license:apache-2.0

Pretrained model on English language using a masked language modeling (MLM) objective. It was introduced in this paper and first released in this repository. This model, as all ALBERT models, is uncased: it does not make a difference between english and English.

Open in MLForge Sign up free Desktop app Source ↗
# pull & run locally
pip install mlforge-sdk && mlforge pull albert/albert-base-v1

Model details

Task
Fill Mask
Provider
albert
Framework
transformers
Parameters
11.8M
Size
171 MB
License
apache-2.0
Downloads
115.8K
Likes
13
Paper
arXiv:1909.11942
Updated
2024-02-19

About albert/albert-base-v1

Pretrained model on English language using a masked language modeling (MLM) objective. It was introduced in this paper and first released in this repository. This model, as all ALBERT models, is uncased: it does not make a difference between english and English.

Related Fill Mask

B google-bert/bert-base-uncased Fill Mask ·110.1M params 75.4M 2.7K 🤗 HF X FacebookAI/xlm-roberta-base Fill Mask ·278.9M params 21.1M 853 🤗 HF R FacebookAI/roberta-base Fill Mask ·124.7M params 11.9M 617 🤗 HF R FacebookAI/roberta-large Fill Mask ·355.4M params 11.5M 301 🤗 HF M answerdotai/ModernBERT-base Fill Mask ·149.7M params 9.4M 1.1K 🤗 HF D distilbert/distilbert-base-uncased Fill Mask ·67.0M params 8.9M 901 🤗 HF

Browse all Fill Mask models →