Task
Text Generation
P
microsoft/phi-4
Text Generation·microsoft· 846.7K· 2.3K
transformers
mit
14.7B params
arxiv:2412.08905
-------------------------------------------------------------------------------------------------------- Developers Microsoft Research Description phi-4 is a state-of-the-art open model built upon a blend of synthetic datasets, data from filtered public domain websites, and acquired academic books and Q&A datasets. Th
# pull & run locally
pip install mlforge-sdk && mlforge pull microsoft/phi-4
pip install mlforge-sdk && mlforge pull microsoft/phi-4
Model details
Provider
microsoft
Framework
transformers
Parameters
14.7B
Size
27 GB
License
mit
Downloads
846.7K
Likes
2.3K
Paper
arXiv:2412.08905
Updated
2025-11-24
About microsoft/phi-4
-------------------------------------------------------------------------------------------------------- Developers Microsoft Research Description phi-4 is a state-of-the-art open model built upon a blend of synthetic datasets, data from filtered public domain websites, and acquired academic books and Q&A datasets. The goal of this approach was to ensure that small capable models were trained with data focused on high quality and advanced reasoning.phi-4 underwent a rigorous enhancement and alignment process, incorporating both supervised fine-tuning and direct preference optimization to ensure precise instruction adherence and robust safety measures Architecture 14B parameters, dense decoder-only Transformer model Inputs Text, best suited for prompts in the chat format Context length 16K tokens GPUs 1920 H100-80G Training time 21 days Training data 9.8T tokens Outputs Generated text in response to input Dates October 2024 – November 2024 Status Static model t