MMLForge Search models, datasets, tasks… Start free
Home › Models › Fill Mask › cointegrated/rubert-tiny
R

cointegrated/rubert-tiny

Fill Mask·cointegrated· 65.8K· 47
transformers mit Fill Mask 11.9M params

This is a very small distilled version of the bert-base-multilingual-cased model for Russian and English (45 MB, 12M parameters). There is also an updated version of this model, rubert-tiny2, with a larger vocabulary and better quality on practically all Russian NLU tasks.

Open in MLForge Sign up free Desktop app Source ↗
# pull & run locally
pip install mlforge-sdk && mlforge pull cointegrated/rubert-tiny

Model details

Task
Fill Mask
Provider
cointegrated
Framework
transformers
Parameters
11.9M
Size
713 MB
License
mit
Downloads
65.8K
Likes
47
Updated
2024-02-09

About cointegrated/rubert-tiny

This is a very small distilled version of the bert-base-multilingual-cased model for Russian and English (45 MB, 12M parameters). There is also an updated version of this model, rubert-tiny2, with a larger vocabulary and better quality on practically all Russian NLU tasks.

Related Fill Mask

B google-bert/bert-base-uncased Fill Mask ·110.1M params 75.4M 2.7K 🤗 HF X FacebookAI/xlm-roberta-base Fill Mask ·278.9M params 21.1M 853 🤗 HF R FacebookAI/roberta-base Fill Mask ·124.7M params 11.9M 617 🤗 HF R FacebookAI/roberta-large Fill Mask ·355.4M params 11.5M 301 🤗 HF M answerdotai/ModernBERT-base Fill Mask ·149.7M params 9.4M 1.1K 🤗 HF D distilbert/distilbert-base-uncased Fill Mask ·67.0M params 8.9M 901 🤗 HF

Browse all Fill Mask models →