unsloth/gemma-4-12B-it-qat-GGUF
Any-to-Any • 12B • Updated • 127k • 171
Gemma 4 QAT
Gemma 4 QAT (Quantization-Aware Training) for 3x less memory use and near original accuracy.
Note GGUFs to run:
-
unsloth/gemma-4-26B-A4B-it-qat-GGUF
Image-Text-to-Text • 25B • Updated • 96.1k • 114 -
unsloth/gemma-4-31B-it-qat-GGUF
Image-Text-to-Text • 31B • Updated • 51k • 56 -
unsloth/gemma-4-E4B-it-qat-GGUF
Any-to-Any • 7B • Updated • 37.6k • 47 -
unsloth/gemma-4-E2B-it-qat-GGUF
Any-to-Any • 5B • Updated • 21.7k • 32 -
unsloth/gemma-4-E2B-it-qat-mobile-GGUF
Any-to-Any • 5B • Updated • 9.7k • 13 -
unsloth/gemma-4-E4B-it-qat-mobile-GGUF
Any-to-Any • 7B • Updated • 13.1k • 15 -
unsloth/gemma-4-26B-A4B-it-qat-q4_0-unquantized
Image-Text-to-Text • 27B • Updated • 329 • 2
unsloth/gemma-4-E2B-it-qat-q4_0-unquantized
Any-to-Any • 5B • Updated • 134 • 2Note BF16 Safetensor:
-
unsloth/gemma-4-E4B-it-qat-q4_0-unquantized
Any-to-Any • 8B • Updated • 335 • 2 -
unsloth/gemma-4-12B-it-qat-q4_0-unquantized
Any-to-Any • 12B • Updated • 1.6k • 4 -
unsloth/gemma-4-31B-it-qat-q4_0-unquantized
Image-Text-to-Text • 33B • Updated • 253 • 3 -
unsloth/gemma-4-E2B-it-qat-mobile
Any-to-Any • 2B • Updated • 169 • 2 -
unsloth/gemma-4-E4B-it-qat-mobile
Any-to-Any • 3B • Updated • 94 • 2 -
unsloth/gemma-4-E4B-it-qat-w4a16
Any-to-Any • 9B • Updated • 839 • 2 -
unsloth/gemma-4-E2B-it-qat-w4a16
Any-to-Any • 6B • Updated • 793 • 2