MedGemma-27B-IT-FP8-Dynamic is an FP8 Dynamic–quantized derivative of Google’s MedGemma-27B-IT model, optimized for high-throughput inference while preserving strong performance on medical and biomedical instruction-tuned tasks.
This version is intended for vLLM deployment on modern NVIDIA GPUs and follows a safe FP8 Dynamic quantization strategy that avoids known instability issues related to vision components.
