NVFP4 quantization of
deepreinforce-ai/Ornith-1.0-35B, a 35B parameter Qwen3.5 MoE coding agent with 256 experts (8 active per token).
Ornith-1.0-35B is the lightweight member of the Ornith family, designed for efficient single-GPU deployment.
Quantized from the BF16 safetensors using
llama.cpp (build 537).
NVFP4 (NVIDIA FP4) uses 4-bit floating point quantization optimized for NVIDIA Blackwell GPUs.
1llama-server \
2 -m ornith-1.0-35b-nvfp4.gguf \
3 -ngl 99 \
4 --host 0.0.0.0 \
5 --port 8080