👉 APEX Quantization Method
Ettore Di Giacinto & Richard Palethorpe (LocalAI Team). ONYX evolves the layer-wise precision gradients and MoE-aware tensor classification outlined in the APEX technical paper into a fully dynamic, data-driven engine.
👉 Bartowski and Lamim
For the excellent semantic imatrix calibration dataset that powers ONYX's activation scaling.
👉 llama.cpp
Georgi Gerganov and contributors for the foundational inference and quantization engine.
👉 HuggingFace Accelerate
For the init_empty_weights() context manager that makes the 0-RAM "Ghost Model" possible on consumer hardware.
