HomeModelsText GenerationGrahLnn/Hy-MT2-30B-A3B-4bit-GGUF
H

GrahLnn/Hy-MT2-30B-A3B-4bit-GGUF

Text Generation·GrahLnn· 3.3K· 9
llama.cpp Text Generation

GGUF quantizations of tencent/Hy-MT2-30B-A3B, with Q4KM as the recommended 4bit deployment file.

Open in MLForge Sign up free Desktop app Source ↗
# pull & run locally
pip install mlforge-sdk && mlforge pull GrahLnn/Hy-MT2-30B-A3B-4bit-GGUF

Model details

Task
Text Generation
Provider
GrahLnn
Framework
llama.cpp
Size
41 GB
Downloads
3.3K
Likes
9
Updated
2026-05-23

About GrahLnn/Hy-MT2-30B-A3B-4bit-GGUF

GGUF quantizations of tencent/Hy-MT2-30B-A3B, with Q4KM as the recommended 4bit deployment file.

Related Text Generation

Q Qwen/Qwen3-0.6B Text Generation ·751.6M params 27.8M 1.4K 🤗 HF G openai-community/gpt2 Text Generation ·137.0M params 13.3M 3.3K 🤗 HF Q Qwen/Qwen3-8B Text Generation ·8.2B params 13.0M 1.2K 🤗 HF Q Qwen/Qwen2.5-7B-Instruct Text Generation ·7.6B params 12.8M 1.4K 🤗 HF O facebook/opt-125m Text Generation 12.3M 267 🤗 HF Q Qwen/Qwen2.5-1.5B-Instruct Text Generation ·1.5B params 11.3M 748 🤗 HF

Browse all Text Generation models →