Task
Other
M
cyankiwi/Ministral-3-8B-Instruct-2512-AWQ-4bit
Other·cyankiwi· 69.3K· 2
- Quantization Method: AWQ - Bits: 4 - Group Size: 32 - Calibration Dataset: 5CD-AI/LLaVA-CoT-o1-Instruct - Quantization Tool: llm-compressor
# pull & run locally
pip install mlforge-sdk && mlforge pull cyankiwi/Ministral-3-8B-Instruct-2512-AWQ-4bit
pip install mlforge-sdk && mlforge pull cyankiwi/Ministral-3-8B-Instruct-2512-AWQ-4bit
Model details
Provider
cyankiwi
Framework
vllm
Parameters
2.7B
Size
27 GB
License
apache-2.0
Downloads
69.3K
Likes
2
Updated
2026-01-13
About cyankiwi/Ministral-3-8B-Instruct-2512-AWQ-4bit
- Quantization Method: AWQ - Bits: 4 - Group Size: 32 - Calibration Dataset: 5CD-AI/LLaVA-CoT-o1-Instruct - Quantization Tool: llm-compressor