HomeDatasetsopenai/openai_humaneval
O

openai/openai_humaneval

Text2text Generation · openai· 314.8K
["mit"] 190 KB

Dataset Card for OpenAI HumanEval Dataset Summary The HumanEval dataset released by OpenAI includes 164 programming problems with a function sig- nature, docstring, body, and several unit tests. They were handwritten to ensure not to be included in the training set of code generation models. Supported Tasks and Leaderboards Languages The programming problems are written in Python and contain English natural text in comments and docstrings.… See the full description on the dataset page: https://huggingface.co/datasets/openai/openai_humaneval.

Open in MLForge Sign up free Desktop app
# download instantly
mlforge datasets pull openai/openai_humaneval

Dataset details

Task
Text2text Generation
Language
en
License
["mit"]
Size
190 KB
Rows / images
164
Classes
5
Creator
openai
Downloads
314.8K
Source
huggingface_datasets
Updated
2024-01-04

About openai/openai_humaneval

Table of Contents - OpenAI HumanEval - Table of Contents - Dataset Description - Dataset Summary - Supported Tasks and Leaderboards - Languages - Dataset Structure - Data Instances - Data Fields - Data Splits - Dataset Creation - Curation Rationale - Source Data - Initial Data Collection and Normalization - Who are the source language producers? - Annotations - Annotation process - Who are the annotators? - Personal and Sensitive Information - Considerations for Using the Data - Social Impact of Dataset - Discussion of Biases - Other Known Limitations - Additional Information - Dataset Curators - Licensing Information - Citation Information - Contributions