This repo contains OPAL Quants of FINAL-Bench/Darwin-36B-Opus
Tier Name
Target Size
Middle Layer Strategy
💎 quality
~23 GB
IQ4_XS
⚖️ balanced
~25 GB
Q5_K
📦 compact
~18 GB
Q3_K
🚀 mini
~14 GB
IQ2_S
🔬 micro
~11 GB
IQ1_M
🤏 nano
~12 GB
IQ2_XXS
🛡️ exp-minimalist
~16 GB
IQ2_XXS (Protected Edges)
📚 Credits
👉 APEX Quantization Method Ettore Di Giacinto & Richard Palethorpe (LocalAI Team). OPAL adapts the layer-wise precision gradients and MoE-aware tensor classification outlined in the APEX technical paper.
👉 Bartowski and Lamim For the excellent semantic imatrix calibration dataset that powers OPAL's activation scaling.
👉 llama.cpp Georgi Gerganov and contributors for the foundational inference and quantization engine.
👉 HuggingFace Accelerate For the init_empty_weights() context manager that makes the 0-RAM "Ghost Model" possible.
👉 Jackrong For the sexy markdown readme inspo.
Support the Project
A coffee in Ethereum would be cool! Although I don't drink coffee—I think it tastes like burnt water—but a pink lemonade would be fire! 🔥