hugging-quants/Meta-Llama-3.1-70B-Instruct-AWQ-INT4

Text Generation·hugging-quants· 301.9K· 109

[!IMPORTANT] This repository is a community-driven quantized version of the original model meta-llama/Meta-Llama-3.1-70B-Instruct which is the FP16 half-precision official version released by Meta AI.

Open in MLForge Sign up free Desktop app Source ↗

# pull & run locally
pip install mlforge-sdk && mlforge pull hugging-quants/Meta-Llama-3.1-70B-Instruct-AWQ-INT4

Model details

Task

Text Generation

Provider

hugging-quants

Framework

transformers

Size

37 GB

License

llama3.1

Downloads

301.9K

Likes

109

Updated

2024-08-07

About hugging-quants/Meta-Llama-3.1-70B-Instruct-AWQ-INT4

Related Text Generation

Q Qwen/Qwen3-0.6B Text Generation ·751.6M params 27.8M 1.4K 🤗 HF G openai-community/gpt2 Text Generation ·137.0M params 13.3M 3.3K 🤗 HF Q Qwen/Qwen3-8B Text Generation ·8.2B params 13.0M 1.2K 🤗 HF Q Qwen/Qwen2.5-7B-Instruct Text Generation ·7.6B params 12.8M 1.4K 🤗 HF O facebook/opt-125m Text Generation 12.3M 267 🤗 HF Q Qwen/Qwen2.5-1.5B-Instruct Text Generation ·1.5B params 11.3M 748 🤗 HF

Browse all Text Generation models →