MMLForge Search models, datasets, tasks… Start free
Home › Models › Text Generation › stelterlab/Mistral-Small-24B-Instruct-2501-AWQ
M

stelterlab/Mistral-Small-24B-Instruct-2501-AWQ

Text Generation·stelterlab· 252.1K· 29
vllm apache-2.0 Text Generation 23.6B params

AWQ quantization: done by stelterlab in INT4 GEMM with AutoAWQ by casper-hansen (https://github.com/casper-hansen/AutoAWQ/)

Open in MLForge Sign up free Desktop app Source ↗
# pull & run locally
pip install mlforge-sdk && mlforge pull stelterlab/Mistral-Small-24B-Instruct-2501-AWQ

Model details

Task
Text Generation
Provider
stelterlab
Framework
vllm
Parameters
23.6B
Size
13 GB
License
apache-2.0
Downloads
252.1K
Likes
29
Updated
2025-03-30

About stelterlab/Mistral-Small-24B-Instruct-2501-AWQ

AWQ quantization: done by stelterlab in INT4 GEMM with AutoAWQ by casper-hansen (https://github.com/casper-hansen/AutoAWQ/)

Related Text Generation

Q Qwen/Qwen3-0.6B Text Generation ·751.6M params 27.8M 1.4K 🤗 HF G openai-community/gpt2 Text Generation ·137.0M params 13.3M 3.3K 🤗 HF Q Qwen/Qwen3-8B Text Generation ·8.2B params 13.0M 1.2K 🤗 HF Q Qwen/Qwen2.5-7B-Instruct Text Generation ·7.6B params 12.8M 1.4K 🤗 HF O facebook/opt-125m Text Generation 12.3M 267 🤗 HF Q Qwen/Qwen2.5-1.5B-Instruct Text Generation ·1.5B params 11.3M 748 🤗 HF

Browse all Text Generation models →