MMLForge Search models, datasets, tasks… Start free
Home › Datasets › codeparrot/apps
A

codeparrot/apps

Text Generation · codeparrot· 17.4K
["mit"] 11 GB

Dataset Description APPS is a benchmark for code generation with 10000 problems. It can be used to evaluate the ability of language models to generate code from natural language specifications. You can also find APPS metric in the hub here codeparrot/appsmetric.

Open in MLForge Sign up free Desktop app
# download instantly
mlforge datasets pull codeparrot/apps

Dataset details

Task
Text Generation
Language
code
License
["mit"]
Size
11 GB
Creator
codeparrot
Downloads
17.4K
Source
huggingface_datasets
Updated
2022-10-20

About codeparrot/apps

Dataset Description APPS is a benchmark for code generation with 10000 problems. It can be used to evaluate the ability of language models to generate code from natural language specifications. You can also find APPS metric in the hub here codeparrot/appsmetric.