Jeethu/ReAligned-Qwen3.5-2B-PARO

Name: ReAligned-Qwen3.5-2B-PARO
Availability: InStock

Pairwise Rotation Quantization for Efficient Reasoning LLM Inference

Paper

ParoQuant is the state-of-the-art INT4 quantization for LLMs. It closes the accuracy gap with FP16 while running at near-AWQ speed. Supports NVIDIA GPUs (vLLM, Transformers) and Apple Silicon (MLX). For more information, see https://github.com/z-lab/paroquant.

Jeethu/ReAligned-Qwen3.5-2B is a 4-bit Lazarus-Ai/ReAligned-Qwen3.5-2B quantized with ParoQuant.