Task
Text Generation
L
nvidia/Llama-3.1-8B-Instruct-FP8
Text Generation·nvidia· 259.4K· 37
transformers
llama3.1
Text Generation
8.0B params
base_model:meta-llama/Llama-3.1-8B-Instructbase_model:finetune:meta-llama/Llama-3.1-8B-Instructlicense:llama3.1region:us
Description: The NVIDIA Llama 3.1 8B Instruct FP8 model is the quantized version of the Meta's Llama 3.1 8B Instruct model, which is an auto-regressive language model that uses an optimized transformer architecture. For more information, please check here. The NVIDIA Llama 3.1 8B Instruct FP8 model is quantized with TensorRT Model Optimizer.
# pull & run locally
pip install mlforge-sdk && mlforge pull nvidia/Llama-3.1-8B-Instruct-FP8
pip install mlforge-sdk && mlforge pull nvidia/Llama-3.1-8B-Instruct-FP8
Model details
Provider
nvidia
Framework
transformers
Parameters
8.0B
Size
25 GB
License
llama3.1
Downloads
259.4K
Likes
37
Updated
2025-08-22
About nvidia/Llama-3.1-8B-Instruct-FP8
Description: The NVIDIA Llama 3.1 8B Instruct FP8 model is the quantized version of the Meta's Llama 3.1 8B Instruct model, which is an auto-regressive language model that uses an optimized transformer architecture. For more information, please check here. The NVIDIA Llama 3.1 8B Instruct FP8 model is quantized with TensorRT Model Optimizer.