NVFP4 quantization of Qwen/Qwen-AgentWorld-35B-A3B, a 35B parameter Mixture-of-Experts model with 3B active parameters, designed for agent tasks and world modeling with vision support.

About the Model

Qwen AgentWorld is a specialized variant of the Qwen 3.5 MoE architecture optimized for:

Agent tasks — tool calling, function execution, environment simulation
World modeling — understanding and predicting environment states
Vision understanding — multimodal image input via separate mmproj vision projector
35B total parameters with only 3B active per token (256 experts, 8 active)
Efficient inference — MoE architecture activates only a fraction of parameters

Architecture

Text model: Qwen3.5 MoE — 40 layers, 2048 hidden, 256 experts (8 active/token)
Vision encoder: 27-layer SigLIP-style, 1152 hidden, patch_size 16 (via mmproj)
Vocabulary: 248,320 tokens

Quantization

This GGUF was quantized from the BF16 safetensors using llama.cpp (build 537). The source weights were converted to F16 GGUF, then quantized to NVFP4 format.

NVFP4 (NVIDIA FP4) uses 4-bit floating point quantization optimized for NVIDIA Blackwell (B-series) GPUs.

Files

File	Size	Description
qwen-agentworld-35b-a3b-nvfp4.gguf	~18.4 GB	NVFP4 quantized model weights
mmproj-qwen-agentworld-35b-a3b-f16.gguf	~843 MB	Vision projector (BF16)

Usage

llama.cpp

ash llama-server \   -m qwen-agentworld-35b-a3b-nvfp4.gguf \   --mmproj mmproj-qwen-agentworld-35b-a3b-f16.gguf \   -ngl 99 \   --host 0.0.0.0 \   --port 8080

LM Studio

Download both files from this repository
Load the main GGUF file in LM Studio
Load the mmproj file for vision support
Set GPU offload layers to maximum

Hardware Requirements

Minimum: 20 GB VRAM for partial offload
Recommended: 24+ GB VRAM for full GPU offload
Disk: ~19.2 GB

License

Apache 2.0 — same as the base model.

FreedomAISVR/Qwen-AgentWorld-35B-A3B-NVFP4-GGUF

Qwen AgentWorld 35B-A3B — NVFP4 GGUF