BioMistral-7B-FP8-Dynamic is an FP8 Dynamic–quantized version of the BioMistral-7B model, designed for high-performance inference while maintaining strong quality on biomedical and medical NLP tasks.
This model is primarily intended for deployment with vLLM on modern GPUs (Hopper / Ada architectures).
