FacebookAI/roberta-base

Fill Mask·FacebookAI· 11.9M· 617

transformers mit 124.7M params dataset:bookcorpusdataset:wikipedia

fill mask · transformers model

Open in MLForge Sign up free Desktop app Source ↗

# pull & run locally
pip install mlforge-sdk && mlforge pull FacebookAI/roberta-base

Model details

Task

Fill Mask

Provider

FacebookAI

Framework

transformers

Parameters

124.7M

License

mit

Downloads

11.9M

Likes

617

Paper

arXiv:1907.11692

Updated

2024-02-19

About FacebookAI/roberta-base

Pretrained model on English language using a masked language modeling (MLM) objective. It was introduced in this paper and first released in this repository. This model is case-sensitive: it makes a difference between english and English.

Related Fill Mask

B google-bert/bert-base-uncased Fill Mask ·110.1M params 60.5M 2.7K 🤗 HF X FacebookAI/xlm-roberta-base Fill Mask ·278.9M params 21.1M 853 🤗 HF R FacebookAI/roberta-large Fill Mask ·355.4M params 11.5M 301 🤗 HF M answerdotai/ModernBERT-base Fill Mask ·149.7M params 9.4M 1.1K 🤗 HF D distilbert/distilbert-base-uncased Fill Mask ·67.0M params 8.9M 901 🤗 HF X FacebookAI/xlm-roberta-large Fill Mask ·561.2M params 7.1M 519 🤗 HF