DeepPavlov/rubert-base-cased

Feature Extraction·DeepPavlov· 303.4K· 131

transformers Feature Extraction arxiv:1905.07213deploy:azureregion:us

RuBERT \(Russian, cased, 12‑layer, 768‑hidden, 12‑heads, 180M parameters\) was trained on the Russian part of Wikipedia and news data. We used this training data to build a vocabulary of Russian subtokens and took a multilingual version of BERT‑base as an initialization for RuBERT\[1\].

Open in MLForge Sign up free Desktop app Source ↗

# pull & run locally
pip install mlforge-sdk && mlforge pull DeepPavlov/rubert-base-cased

Model details

Task

Feature Extraction

Provider

DeepPavlov

Framework

transformers

Size

6.3 GB

Downloads

303.4K

Likes

131

Paper

arXiv:1905.07213

Updated

2021-11-23

About DeepPavlov/rubert-base-cased

Related Feature Extraction

B BAAI/bge-small-en-v1.5 Feature Extraction ·33.4M params 61.8M 497 🤗 HF B BAAI/bge-large-en-v1.5 Feature Extraction ·335.1M params 14.9M 688 🤗 HF Q Qwen/Qwen3-Embedding-0.6B Feature Extraction ·595.8M params 10.5M 1.1K 🤗 HF B BAAI/bge-base-en-v1.5 Feature Extraction ·109.5M params 8.6M 441 🤗 HF M intfloat/multilingual-e5-large Feature Extraction ·559.9M params 8.1M 1.2K 🤗 HF M mixedbread-ai/mxbai-embed-large-v1 Feature Extraction ·335.1M params 6.0M 810 🤗 HF

Browse all Feature Extraction models →