MMLForge Search models, datasets, tasks… Start free

Home › Models › Other › google/fnet-base

F

google/fnet-base

Other·google· 1.3M· 18

transformers apache-2.0 dataset:c4arxiv:2105.03824license:apache-2.0region:us

Pretrained model on English language using a masked language modeling (MLM) and next sentence prediction (NSP) objective. It was introduced in this paper and first released in this repository. This model is cased: it makes a difference between english and English. The model achieves 0.58 accuracy on MLM objective and 0.80 on NSP objective.

Open in MLForge Sign up free Desktop app Source ↗

# pull & run locally
pip install mlforge-sdk && mlforge pull google/fnet-base

Model details

Task

Other

Provider

google

Framework

transformers

Size

1.0 GB

License

apache-2.0

Downloads

1.3M

Likes

18

Paper

arXiv:2105.03824

Updated

2024-02-29

About google/fnet-base

Pretrained model on English language using a masked language modeling (MLM) and next sentence prediction (NSP) objective. It was introduced in this paper and first released in this repository. This model is cased: it makes a difference between english and English. The model achieves 0.58 accuracy on MLM objective and 0.80 on NSP objective.

Related Other

E google/electra-base-discriminator Other 41.9M 128 🤗 HF A Bingsu/adetailer Other 12.6M 729 🤗 HF C colbert-ir/colbertv2.0 Other ·109.6M params 11.8M 362 🤗 HF C facebook/contriever Other 7.5M 93 🤗 HF W pyannote/wespeaker-voxceleb-resnet34-LM Other 7.3M 146 🤗 HF U lpiccinelli/unidepth-v2-vitl14 Other ·353.8M params 5.4M 34 🤗 HF