Task
Text Generation
See our collection for all versions of Llama 3.2 including GGUF, 4-bit and original 16-bit formats. Dynamic 4-bit: Unsloth's Dynamic 4-bit Quants selectively avoids quantizing certain parameters, greatly increase accuracy than standard 4-bit.See our full collection of Unsloth quants on Hugging Face here.
See our collection for all versions of Llama 3.2 including GGUF, 4-bit and original 16-bit formats. Dynamic 4-bit: Unsloth's Dynamic 4-bit Quants selectively avoids quantizing certain parameters, greatly increase accuracy than standard 4-bit.See our full collection of Unsloth quants on Hugging Face here.