NEXUS-Security-MLX-4bit – AI Model by ahmedandaloes | AlphaNeural AI

You can deploy this model and start earning money today!

ahmedandaloes/
NEXUS-Security-MLX-4bit

like

0

offensive-security

text-generation

fableforge-ai/NEXUS-Security

Views

No views yet

NEXUS-Security — MLX 4-bit

4-bit quantized MLX build of fableforge-ai/NEXUS-Security (Qwen2ForCausalLM, ~1.5B), for fast local inference on Apple Silicon.

Precision: 4-bit affine, group size 64.
Size: ~0.9 GB · retention: ~95-98%
Converted with: mlx-lm, mlx.

Weights unchanged from the source — format + precision conversion only.

Other builds

Build	Bits	Size
MLX-4bit	4	~0.9 GB
MLX-6bit	6	~1.3 GB
MLX-8bit	8	~1.7 GB
MLX-bf16	bf16	~3 GB

GGUF builds (llama.cpp/Ollama): King3Djbl/nexus-security-GGUF.

Usage

pip install mlx-lm

python

from mlx_lm import load, generate
model, tok = load("ahmedandaloes/NEXUS-Security-MLX-4bit")
msgs=[{"role":"user","content":"Name one common web vulnerability."}]
p=tok.apply_chat_template(msgs, add_generation_prompt=True)
print(generate(model, tok, prompt=p, max_tokens=256, verbose=True))

Attribution & license

Source: fableforge-ai/NEXUS-Security · base Qwen/Qwen2-1.5B
License Apache-2.0 (verify against source). MLX build for the Apple Silicon community.
For authorized security work only.