MMLForge Search models, datasets, tasks… Start free
Home › Models › Text Generation › RedHatAI/Meta-Llama-3.1-8B-Instruct-FP8
M

RedHatAI/Meta-Llama-3.1-8B-Instruct-FP8

Text Generation·RedHatAI· 531.4K· 44
transformers llama3.1 8.0B params

Model Overview - Model Architecture: Meta-Llama-3.1 - Input: Text - Output: Text - Model Optimizations: - Weight quantization: FP8 - Activation quantization: FP8 - Intended Use Cases: Intended for commercial and research use in multiple languages. Similarly to Meta-Llama-3.1-8B-Instruct, this models is intended for assistant-like chat. - Out-of-scope: Use in any manner that violates applic

Open in MLForge Sign up free Desktop app Source ↗
# pull & run locally
pip install mlforge-sdk && mlforge pull RedHatAI/Meta-Llama-3.1-8B-Instruct-FP8

Model details

Task
Text Generation
Provider
RedHatAI
Framework
transformers
Parameters
8.0B
Size
17 GB
License
llama3.1
Downloads
531.4K
Likes
44
Updated
2024-10-09

About RedHatAI/Meta-Llama-3.1-8B-Instruct-FP8

Model Overview - Model Architecture: Meta-Llama-3.1 - Input: Text - Output: Text - Model Optimizations: - Weight quantization: FP8 - Activation quantization: FP8 - Intended Use Cases: Intended for commercial and research use in multiple languages. Similarly to Meta-Llama-3.1-8B-Instruct, this models is intended for assistant-like chat. - Out-of-scope: Use in any manner that violates applicable laws or regulations (including trade compliance laws). Use in languages other than English. - Release Date: 7/23/2024 - Version: 1.0 - License(s): llama3.1 - Model Developers: Neural Magic

Related Text Generation

Q Qwen/Qwen3-0.6B Text Generation ·751.6M params 27.8M 1.4K 🤗 HF Q Qwen/Qwen3-4B Text Generation ·4.0B params 16.4M 641 🤗 HF G openai-community/gpt2 Text Generation ·137.0M params 13.3M 3.3K 🤗 HF Q Qwen/Qwen3-8B Text Generation ·8.2B params 13.0M 1.2K 🤗 HF Q Qwen/Qwen2.5-7B-Instruct Text Generation ·7.6B params 12.8M 1.4K 🤗 HF O facebook/opt-125m Text Generation 12.3M 267 🤗 HF