MMLForge Search models, datasets, tasks… Start free

Home › Models › Vllm

Vllm Models

25

25 vllm models on MLForge, ranked by downloads — including work from mistralai, stelterlab, mlx-community, ocicek. Compare, download and run them locally on your own GPU. Free tier.

Start free Desktop app

Top Vllm models

M mistralai/Mistral-7B-Instruct-v0.3 Other ·7.2B params 2.8M 2.7K 🤗 HF V mistralai/Voxtral-Mini-4B-Realtime-2602 Automatic Speech Recognition ·4.4B params 1.9M 897 🤗 HF M mistralai/Ministral-3-3B-Instruct-2512 Other ·3.8B params 1.2M 253 🤗 HF M mistralai/Mistral-Small-3.2-24B-Instruct-2506 Other ·24.0B params 663.4K 596 🤗 HF M mistralai/Mixtral-8x7B-Instruct-v0.1 Other ·46.7B params 523.3K 4.7K 🤗 HF D mistralai/Devstral-Small-2-24B-Instruct-2512 Other ·24.0B params 347.9K 625 🤗 HF M mistralai/Ministral-8B-Instruct-2410 Other ·8.0B params 312.3K 584 🤗 HF M stelterlab/Mistral-Small-24B-Instruct-2501-AWQ Text Generation ·23.6B params 252.1K 29 🤗 HF M mistralai/Mistral-Small-3.1-24B-Instruct-2503 Other ·24.0B params 158.2K 1.4K 🤗 HF M mistralai/Mistral-Nemo-Instruct-2407 Other ·12.2B params 135.2K 1.7K 🤗 HF M mistralai/Ministral-3-14B-Instruct-2512 Other ·13.9B params 132.9K 296 🤗 HF D mlx-community/Devstral-Small-2-24B-Instruct-2512-4bit Other 132.5K 5 🤗 HF M mistralai/Mistral-Small-Instruct-2409 Other ·22.2B params 118.2K 393 🤗 HF M mistralai/Mistral-7B-v0.3 Other ·7.2B params 113.2K 586 🤗 HF V mistralai/Voxtral-Small-24B-2507 Audio Text To Text ·24.3B params 108.5K 504 🤗 HF M mistralai/Ministral-3-8B-Instruct-2512 Other ·8.9B params 101.7K 180 🤗 HF Q ocicek/Qwen3.6-27B-NVFP4 Text Generation ·17.1B params 85.4K 5 🤗 HF M mistralai/Ministral-3-8B-Reasoning-2512 Other ·8.9B params 79.5K 85 🤗 HF V mistralai/Voxtral-4B-TTS-2603 Text To Speech 74.5K 868 🤗 HF M cyankiwi/Ministral-3-8B-Instruct-2512-AWQ-4bit Other ·2.7B params 69.3K 2 🤗 HF Q rdtand/Qwen3.6-27B-PrismaSCOUT-Blackwell-NVFP4-BF16-vllm Other ·17.0B params 68.9K 34 🤗 HF M cyankiwi/Ministral-3-14B-Reasoning-2512-AWQ-4bit Other ·3.7B params 57.2K 1 🤗 HF H sakamakismile/Huihui-Qwen3.6-27B-abliterated-NVFP4-MTP Text Generation ·17.1B params 44.7K 62 🤗 HF L Mungert/LightOnOCR-1B-1025-GGUF Image To Text 258 1 🤗 HF F Ryex/Floppa-12B-Gemma3-Uncensored-GPTQ Image Text To Text ·3.9B params 229 🤗 HF

Other frameworks