HomeModelsFill Maskmicrosoft/BiomedVLP-CXR-BERT-specialized
B

microsoft/BiomedVLP-CXR-BERT-specialized

Fill Mask·microsoft· 449.0K· 36
transformers mit Fill Mask 109.6M params arxiv:2204.09817arxiv:2103.00020arxiv:2002.05709

CXR-BERT is a chest X-ray (CXR) domain-specific language model that makes use of an improved vocabulary, novel pretraining procedure, weight regularization, and text augmentations. The resulting model demonstrates improved performance on radiology natural language inference, radiology masked language model token prediction, and downstream vision-language processing tasks such as zero-shot phrase g

Open in MLForge Sign up free Desktop app Source ↗
# pull & run locally
pip install mlforge-sdk && mlforge pull microsoft/BiomedVLP-CXR-BERT-specialized

Model details

Task
Fill Mask
Provider
microsoft
Framework
transformers
Parameters
109.6M
Size
935 MB
License
mit
Downloads
449.0K
Likes
36
Paper
arXiv:2204.09817
Updated
2025-07-25

About microsoft/BiomedVLP-CXR-BERT-specialized

CXR-BERT is a chest X-ray (CXR) domain-specific language model that makes use of an improved vocabulary, novel pretraining procedure, weight regularization, and text augmentations. The resulting model demonstrates improved performance on radiology natural language inference, radiology masked language model token prediction, and downstream vision-language processing tasks such as zero-shot phrase grounding and image classification.

Related Fill Mask

B google-bert/bert-base-uncased Fill Mask ·110.1M params 75.4M 2.7K 🤗 HF X FacebookAI/xlm-roberta-base Fill Mask ·278.9M params 21.1M 853 🤗 HF R FacebookAI/roberta-base Fill Mask ·124.7M params 11.9M 617 🤗 HF R FacebookAI/roberta-large Fill Mask ·355.4M params 11.5M 301 🤗 HF M answerdotai/ModernBERT-base Fill Mask ·149.7M params 9.4M 1.1K 🤗 HF D distilbert/distilbert-base-uncased Fill Mask ·67.0M params 8.9M 901 🤗 HF

Browse all Fill Mask models →