This model is an abliterated (uncensored) version of nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 that has had its refusal mechanisms removed using PRISM (Projected Refusal Isolation via Subspace Modification). The model will respond to prompts that the original model would refuse.
Key Specs:
The model employs a hybrid Mixture-of-Experts (MoE) architecture, consisting of 23 Mamba-2 and MoE layers, along with 6 Attention layers. Each MoE layer includes 128 experts plus 1 shared expert, with 6 experts activated per token. The model has 3.5B active parameters and 30B parameters in total.
31.58B parameter hybrid architecture
52-layer design (Mamba-2 + MoE + Attention)
1M token context length (1,048,576)
BF16 precision
Text generation with reasoning capabilities
The supported languages include: English, German, Spanish, French, Italian, and Japanese. Improved using Qwen.
This model is ready for commercial use.
Motivation
This project exists as research and development experimentation into understanding how large language models encode and enforce refusal behaviors, contributing to broader AI safety research by providing empirical data on refusal mechanism localization and tradeoffs between safety and capability.
1# Pull and run directly from Hugging Face2ollama pull hf.co/Ex0bit/Elbaz-NVIDIA-Nemotron-3-Nano-30B-A3B-PRISM
3ollama run hf.co/Ex0bit/Elbaz-NVIDIA-Nemotron-3-Nano-30B-A3B-PRISM
Note: The hf.co/ prefix is required to pull from Hugging Face. Requires Ollama 0.3.0+.
PRISM Methodology
Method: Projected Refusal Isolation via Subspace Modification
The model was abliterated using PRISM - a state-of-the-art abliteration methodology combining multiple principled techniques for effective refusal removal while preserving model capabilities.
Hardware Requirements
Quantization
Min VRAM
Recommended
Hardware Examples
IQ4_XS
12 GB
16+ GB
RTX 4090, A100, Apple M2/M3/M4 Pro/Max
Q6_K
24 GB
32+ GB
RTX 4090, A100 40GB, Apple M3/M4 Max
Q8_0
24 GB
32+ GB
RTX 4090, A100 40GB, Apple M3/M4 Max
BF16
64 GB
80+ GB
A100 80GB, H100, Multi-GPU setups
Note: The IQ4_XS quantization runs well on consumer hardware with 16GB+ VRAM.
Ethical Considerations
This model has been modified to reduce safety guardrails. Users are responsible for:
Complying with all applicable laws and regulations
Not using the model for illegal activities
Understanding the potential risks of unrestricted AI responses
Implementing appropriate safeguards in production environments