Impish_LLAMA_3B_Abliterated is an abliterated variant of SicariusSicariiStuff/Impish_LLAMA_3B with surgical removal of refusal mechanisms. This model maintains the full capabilities of the original, while eliminating safety guardrails through orthogonalization techniques.
KL divergence
<0.01
Refusals
~8%
What is KL divergence?
Think about it as a way to measure the variance between the original model "World Model," vs the abliterated one; the lower the KL divergence, the closer the "World Model" of the two models to each other.
If the original model thinks making pineapple pizza is a crime against humanity (it is), then the abliterated model will still hold to this belief, but if asked how to make one (probably after giving you a disclaimer about what an abomination that is), it would still tell you how. In other words, most of the knowledge, quirks, and capabilities are preserved.
Technical Specs
Base Model: Impish_LLAMA_3B
Parameters: 3B
Context Length: 128K tokens
Architecture: Llama (decoder-only transformer)
Precision: fp16
Method: Orthogonalization-based abliteration
License: Llama 3.1 Community License
Methodology
Identifies refusal direction vectors in activation space
Orthogonalizes weights to inhibit activation along these directions
Preserves (mostly) all other model behaviors and knowledge
Model Details
Intended use: General Tasks, Roleplay.
Censorship level: Very Low
X / 10 (10 completely uncensored)
UGI score:
pending evals
Citation Information
@llm{Impish_LLAMA_3B_Abliterated,
author = {SicariusSicariiStuff},
title = {Impish_LLAMA_3B_Abliterated},
year = {2026},
publisher = {Hugging Face},
url = {https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_3B_Abliterated}
}
Other stuff
Impish_LLAMA_4B the “Impish experience”, now runnable on spinning rust & toasters.
