Gguf Models
4848 gguf models on MLForge, ranked by downloads — including work from antirez, empero-ai, yuxinlu1, QuantStack. Compare, download and run them locally on your own GPU. Free tier.
Top Gguf models
D
antirez/deepseek-v4-gguf
5.7M 271
🤗 HF
Q
empero-ai/Qwythos-9B-Claude-Mythos-5-1M-GGUF
1.4M 1.3K
🤗 HF
G
yuxinlu1/gemma-4-12B-coder-fable5-composer2.5-v1-GGUF
628.2K 2.6K
🤗 HF
G
yuxinlu1/gemma-4-12B-agentic-fable5-composer2.5-v2-3.5x-tau2-GGUF
329.4K 981
🤗 HF
W
QuantStack/Wan2.2-I2V-A14B-GGUF
182.8K 361
🤗 HF
S
Abiray/Sulphur-2-base-GGUF
176.0K 71
🤗 HF
F
city96/FLUX.2-dev-gguf
143.5K 149
🤗 HF
F
city96/FLUX.1-dev-gguf
117.8K 1.4K
🤗 HF
Q
QuantStack/Qwen-Image-Edit-2509-GGUF
110.2K 344
🤗 HF
Q
bytkim/Qwen3.6-27B-MTP-pi-tune-GGUF
95.1K 119
🤗 HF
U
city96/umt5-xxl-encoder-gguf
81.2K 176
🤗 HF
W
QuantStack/Wan2.2-T2V-A14B-GGUF
80.6K 264
🤗 HF
F
city96/FLUX.1-schnell-gguf
47.2K 339
🤗 HF
Q
hesamation/Qwen3.6-35B-A3B-Claude-4.6-Opus-Reasoning-Distilled-GGUF
46.5K 285
🤗 HF
S
stepfun-ai/Step-3.7-Flash-GGUF
43.4K 138
🤗 HF
Q
Serveurperso/Qwen3-TTS-GGUF
32.2K 20
🤗 HF
L
w-ahmad/LFM2.5-8B-A1B-GGUF-MoQ
32.0K 9
🤗 HF
O
Serveurperso/OmniVoice-GGUF
29.7K 32
🤗 HF
Q
bytkim/Qwen3.6-27B-MTP-pi-reasoning-GGUF
23.4K 47
🤗 HF
Q
city96/Qwen-Image-gguf
12.8K 291
🤗 HF
F
QuantStack/FLUX.1-Krea-dev-GGUF
8.2K 141
🤗 HF
F
lllyasviel/FLUX.1-dev-gguf
7.4K 113
🤗 HF
Q
QuantStack/Qwen-Image-GGUF
6.2K 46
🤗 HF
F
lllyasviel/FLUX.1-schnell-gguf
5.8K 33
🤗 HF
S
city96/stable-diffusion-3.5-large-gguf
5.8K 132
🤗 HF
K
Abiray/Krea-2-Turbo-GGUF
5.4K 10
🤗 HF
F
Eviation/flux-imatrix
5.2K 3
🤗 HF
L
mudler/locate-anything.cpp-gguf
4.7K 6
🤗 HF
Z
babakarto/z-image-base-gguf
4.3K 15
🤗 HF
V
DennisHuang648/VoxCPM2-GGUF
3.4K 4
🤗 HF
F
markury/FLUX.1-Krea-dev-gguf
2.8K
🤗 HF
Q
KuroTo4ka/Qwen3-VL-8B-Instruct-Unredacted-MAX-Quants-GGUF
1.9K 6
🤗 HF
G
trjxter/Gwimi-4-12B-IT-GGUF
1.4K 6
🤗 HF
Q
toxzak/Qwen3.6-27B-Q1_K-GGUF
930
🤗 HF
O
CreativeHub008/OmniVoice-GGUF
623 1
🤗 HF
Q
Abiray/Qianfan-OCR-GGUF
496 1
🤗 HF
O
fablevi/OmniVoice-GGUF-clone
490
🤗 HF
Q
Firemedic15/Qwen2.5_Risk_1.5B
471
🤗 HF
M
MBZUAI/MediX-R1-8B-GGUF
457 1
🤗 HF
O
Supbatomic/OmniVoice-GGUF
394
🤗 HF
T
vjchou/translategemma-4b-it-GGUF
372
🤗 HF
Q
Solidaxel/Qwen3-TTS-12Hz-1.7B-Base-GGUF
361 1
🤗 HF
M
Murasaki-Project/Murasaki-8B-v0.2-GGUF
334 1
🤗 HF
M
MBZUAI/MediX-R1-2B-GGUF
258 1
🤗 HF
M
Murasaki-Project/Murasaki-14B-v0.2-GGUF
214 7
🤗 HF
P
cstr/ppformulanet-l-gguf
198
🤗 HF
M
MBZUAI/MediX-R1-30B-GGUF
168 3
🤗 HF
T
cstr/texo-distill-gguf
138
🤗 HF