Task
Text Generation
N
nvidia/Nemotron-Mini-4B-Instruct
Text Generation·nvidia· 389.1K· 185
Nemotron-Mini-4B-Instruct is a model for generating responses for roleplaying, retrieval augmented generation, and function calling. It is a small language model (SLM) optimized through distillation, pruning and quantization for speed and on-device deployment. It is a fine-tuned version of nvidia/Minitron-4B-Base, which was pruned and distilled from Nemotron-4 15B using our LLM compression techni
# pull & run locally
pip install mlforge-sdk && mlforge pull nvidia/Nemotron-Mini-4B-Instruct
pip install mlforge-sdk && mlforge pull nvidia/Nemotron-Mini-4B-Instruct
Model details
Provider
nvidia
Framework
transformers
Size
23 GB
License
other
Downloads
389.1K
Likes
185
Paper
arXiv:2402.16819
Updated
2025-02-14
About nvidia/Nemotron-Mini-4B-Instruct
Nemotron-Mini-4B-Instruct is a model for generating responses for roleplaying, retrieval augmented generation, and function calling. It is a small language model (SLM) optimized through distillation, pruning and quantization for speed and on-device deployment. It is a fine-tuned version of nvidia/Minitron-4B-Base, which was pruned and distilled from Nemotron-4 15B using our LLM compression technique. This instruct model is optimized for roleplay, RAG QA, and function calling in English. It supports a context length of 4,096 tokens. This model is ready for commercial use.