distilbert/distilbert-base-uncased

Fill Mask·distilbert· 8.9M· 901

transformers apache-2.0 67.0M params dataset:bookcorpusdataset:wikipedia

fill mask · transformers model

Open in MLForge Sign up free Desktop app Source ↗

# pull & run locally
pip install mlforge-sdk && mlforge pull distilbert/distilbert-base-uncased

Model details

Task

Fill Mask

Provider

distilbert

Framework

transformers

Parameters

67.0M

License

apache-2.0

Downloads

8.9M

Likes

901

Paper

arXiv:1910.01108

Updated

2024-05-06

About distilbert/distilbert-base-uncased

This model is a distilled version of the BERT base model. It was introduced in this paper. The code for the distillation process can be found here. This model is uncased: it does not make a difference between english and English.

Related Fill Mask

B google-bert/bert-base-uncased Fill Mask ·110.1M params 60.5M 2.7K 🤗 HF X FacebookAI/xlm-roberta-base Fill Mask ·278.9M params 21.1M 853 🤗 HF R FacebookAI/roberta-base Fill Mask ·124.7M params 11.9M 617 🤗 HF R FacebookAI/roberta-large Fill Mask ·355.4M params 11.5M 301 🤗 HF M answerdotai/ModernBERT-base Fill Mask ·149.7M params 9.4M 1.1K 🤗 HF X FacebookAI/xlm-roberta-large Fill Mask ·561.2M params 7.1M 519 🤗 HF