abhishekchohan/gemma-3-12b-it-quantized-W4A16

Image Text To Text·abhishekchohan· 195.2K· 7

transformers gemma Image Text To Text 12.3B params base_model:google/gemma-3-12b-itbase_model:quantized:google/gemma-3-12b-itlicense:gemmaregion:us

This repository contains W4A16 quantized versions of Google's Gemma 3 instruction-tuned models, making them more accessible for deployment on consumer hardware while maintaining good performance.

Open in MLForge Sign up free Desktop app Source ↗

# pull & run locally
pip install mlforge-sdk && mlforge pull abhishekchohan/gemma-3-12b-it-quantized-W4A16

Model details

Task

Image Text To Text

Provider

abhishekchohan

Framework

transformers

Parameters

12.3B

Size

7.9 GB

License

gemma

Downloads

195.2K

Likes

Updated

2025-03-17

About abhishekchohan/gemma-3-12b-it-quantized-W4A16

This repository contains W4A16 quantized versions of Google's Gemma 3 instruction-tuned models, making them more accessible for deployment on consumer hardware while maintaining good performance.

Related Image Text To Text

G google/gemma-4-26B-A4B-it Image Text To Text ·26.5B params 13.1M 1.2K 🤗 HF G google/gemma-4-31B-it Image Text To Text ·32.7B params 11.2M 3.1K 🤗 HF Q Qwen/Qwen3.5-9B Image Text To Text ·9.7B params 9.8M 1.6K 🤗 HF Q Qwen/Qwen3.5-4B Image Text To Text ·4.7B params 9.6M 683 🤗 HF Q Qwen/Qwen2.5-VL-7B-Instruct Image Text To Text ·8.3B params 9.4M 1.6K 🤗 HF Q Qwen/Qwen3.6-35B-A3B-FP8 Image Text To Text ·36.0B params 5.8M 284 🤗 HF

Browse all Image Text To Text models →