You can deploy this model and start earning money today!

kaitchup/
gemma-4-31B-it-autoround-nvfp4-all

Name: gemma-4-31B-it-autoround-nvfp4-all
Rating: 2.5 (9 reviews)

safetensors

gemma4

autoround

google/gemma-4-31B-it

Views

No views yet

Subscribe and Support

This is google/gemma-4-31B-it quantized with AutoRound to NVFP4. The model is compatible with vLLM (tested: v0.19). Tested with an RTX Pro 6000. Currently under evaluation.

Developed by: The Kaitchup

Instructions

uv pip install vllm
uv pip install git+https://github.com/huggingface/transformers.git

vllm serve [this model ID] --max-model-len 262144 --reasoning-parser gemma4

kaitchup/gemma-4-31B-it-autoround-nvfp4-all

Instructions

kaitchup/
gemma-4-31B-it-autoround-nvfp4-all