neulab/codebert-python

Fill Mask·neulab· 90.9K· 26

transformers Fill Mask 124.7M params arxiv:2302.05527deploy:azureregion:us

This is a microsoft/codebert-base-mlm model, trained for 1,000,000 steps (with batchsize=32) on Python code from the codeparrot/github-code-clean dataset, on the masked-language-modeling task.

Open in MLForge Sign up free Desktop app Source ↗

# pull & run locally
pip install mlforge-sdk && mlforge pull neulab/codebert-python

Model details

Task

Fill Mask

Provider

neulab

Framework

transformers

Parameters

124.7M

Size

1.4 GB

Downloads

90.9K

Likes

Paper

arXiv:2302.05527

Updated

2025-06-12

About neulab/codebert-python

This is a microsoft/codebert-base-mlm model, trained for 1,000,000 steps (with batchsize=32) on Python code from the codeparrot/github-code-clean dataset, on the masked-language-modeling task.

Related Fill Mask

B google-bert/bert-base-uncased Fill Mask ·110.1M params 75.4M 2.7K 🤗 HF X FacebookAI/xlm-roberta-base Fill Mask ·278.9M params 21.1M 853 🤗 HF R FacebookAI/roberta-base Fill Mask ·124.7M params 11.9M 617 🤗 HF R FacebookAI/roberta-large Fill Mask ·355.4M params 11.5M 301 🤗 HF M answerdotai/ModernBERT-base Fill Mask ·149.7M params 9.4M 1.1K 🤗 HF D distilbert/distilbert-base-uncased Fill Mask ·67.0M params 8.9M 901 🤗 HF

Browse all Fill Mask models →