HomeDatasetstasksource/mmlu
M

tasksource/mmlu

Text Classification · tasksource· 39.1K
apache-2.0

MMLU (hendrycks_test on huggingface) without auxiliary train. It is much lighter (7MB vs 162MB) and faster than the original implementation, in which auxiliary train is loaded (+ duplicated!) by default for all the configs in the original version, making it quite heavy. We use this version in tasksource. Reference to original dataset: Measuring Massive Multitask Language Understanding - https://github.com/hendrycks/test @article{hendryckstest2021, title={Measuring Massive Multitask Language… See the full description on the dataset page: https://huggingface.co/datasets/tasksource/mmlu.

Open in MLForge Sign up free Desktop app
# download instantly
mlforge datasets pull tasksource/mmlu

Dataset details

Task
Text Classification
Language
en
License
apache-2.0
Creator
tasksource
Downloads
39.1K
Source
huggingface_datasets
Updated
2025-07-18

About tasksource/mmlu

MMLU (hendryckstest on huggingface) without auxiliary train. It is much lighter (7MB vs 162MB) and faster than the original implementation, in which auxiliary train is loaded (+ duplicated!) by default for all the configs in the original version, making it quite heavy.