You can deploy this model and start earning money today!

TizzyT566/
Ornith-1.5-35B-A3B-NVFP4-GGUF

Name: Ornith-1.5-35B-A3B-NVFP4-GGUF
Availability: InStock

transformers

gguf

text-generation

ornith-ai/Ornith-1.5-35B-A3B-NVFP4

Views

No views yet

Ornith 1.5 35B A3B NVFP4 — GGUF

This repository contains a GGUF conversion of Ornith AI's Ornith-1.5-35B-A3B-NVFP4 checkpoint for use with compatible GGML/llama.cpp-based inference engines.

The purpose of this conversion is to preserve the model's native NVFP4 mixed-precision representation in GGUF rather than requantizing the model into another quantization format.

Model

Base model: ornith-ai/Ornith-1.5-35B-A3B-NVFP4
Architecture: Qwen3.5 MoE
Parameters: 35B total / ~3B active
Quantization: NVFP4
Format: GGUF
Intended runtime: llama.cpp and other runtimes supporting GGUF NVFP4 tensors

Conversion

The original Hugging Face Safetensors checkpoint was converted using the convert_hf_to_gguf.py tooling from llama.cpp.

The conversion preserves the source checkpoint's NVFP4 tensors rather than converting the model to FP16, BF16, or FP32 and subsequently requantizing it.

text

Ornith-1.5-35B-A3B-NVFP4
             │
             │ Hugging Face Safetensors
             ▼
convert_hf_to_gguf.py
             │
             │ Native GGUF NVFP4 representation
             ▼
Ornith-1.5-35B-A3B-NVFP4.gguf
             │
             ▼
          llama.cpp

TizzyT566/Ornith-1.5-35B-A3B-NVFP4-GGUF

Ornith 1.5 35B A3B NVFP4 — GGUF

Model

Conversion

TizzyT566/
Ornith-1.5-35B-A3B-NVFP4-GGUF