qwen3.5-9b-opus-agent-gptq-int8 – AI Model by malvavisc0 | AlphaNeural AI

You can deploy this model and start earning money today!

malvavisc0/
qwen3.5-9b-opus-agent-gptq-int8

like

0

image-text-to-text

text-generation-inference

TeichAI/claude-4.5-opus-high-reasoning-250x

armand0e/badlogicgames-pi-mono-opus-filtered

armand0e/Qwen3.5-9B-Opus-Agent

endpoints_compatible

Views

No views yet

Qwen3.5 9B - Opus Agent (GPTQ Int8)

8-bit GPTQ quantized version of Qwen3.5 9B - Opus Agent.

Quantization: GPTQ 8-bit Framework: vLLM compatible Original model: Apache 2.0

Usage

python

from transformers import AutoModelForCausalLM, AutoTokenizer

model = AutoModelForCausalLM.from_pretrained(
    "malvavisc0/qwen3.5-9b-opus-agent-gptq-int8",
    device_map="auto"
)
tokenizer = AutoTokenizer.from_pretrained("malvavisc0/qwen3.5-9b-opus-agent-gptq-int8")

Benchmarks

Same benchmarks as the original model:

Model	ARC	ARC/E	BoolQ
Qwen3.5-9B-Opus-Agent	0.589	0.747	0.901

Notes

Quantized with GPTQ 8-bit using gptqmodel 7.1.0
Act-aware quantization enabled
Compatible with vLLM for efficient inference