facebook/w2v-bert-2.0

Feature Extraction·facebook· 4.0M· 220

transformers mit 580.5M params

feature extraction · transformers model

Open in MLForge Sign up free Desktop app Source ↗

# pull & run locally
pip install mlforge-sdk && mlforge pull facebook/w2v-bert-2.0

Model details

Task

Feature Extraction

Provider

facebook

Framework

transformers

Parameters

580.5M

License

mit

Downloads

4.0M

Likes

220

Paper

arXiv:2312.05187

Updated

2024-01-25

About facebook/w2v-bert-2.0

We are open-sourcing our Conformer-based W2v-BERT 2.0 speech encoder as described in Section 3.2.1 of the paper, which is at the core of our Seamless models.

Related Feature Extraction

B BAAI/bge-small-en-v1.5 Feature Extraction ·33.4M params 61.8M 497 🤗 HF B BAAI/bge-large-en-v1.5 Feature Extraction ·335.1M params 14.9M 688 🤗 HF Q Qwen/Qwen3-Embedding-0.6B Feature Extraction ·595.8M params 10.5M 1.1K 🤗 HF B BAAI/bge-base-en-v1.5 Feature Extraction ·109.5M params 8.6M 441 🤗 HF M intfloat/multilingual-e5-large Feature Extraction ·559.9M params 8.1M 1.2K 🤗 HF M mixedbread-ai/mxbai-embed-large-v1 Feature Extraction ·335.1M params 6.0M 810 🤗 HF