MMLForge Search models, datasets, tasks… Start free
Home › Datasets › codeparrot/github-code
G

codeparrot/github-code

Text Generation · codeparrot· 2.1M
["other"] 624 GB

Dataset Description The GitHub Code dataset consists of 115M code files from GitHub in 32 programming languages with 60 extensions totaling in 1TB of data. The dataset was created from the public GitHub dataset on Google BiqQuery.

Open in MLForge Sign up free Desktop app
# download instantly
mlforge datasets pull codeparrot/github-code

Dataset details

Task
Text Generation
Language
code
License
["other"]
Size
624 GB
Creator
codeparrot
Downloads
2.1M
Source
huggingface_datasets
Updated
2022-10-20

About codeparrot/github-code

Dataset Description The GitHub Code dataset consists of 115M code files from GitHub in 32 programming languages with 60 extensions totaling in 1TB of data. The dataset was created from the public GitHub dataset on Google BiqQuery.