Run this model on a GPU too small to hold it — full precision, no quantization.
DeepswapLLM streams layers across GPU, RAM, and disk, and runs up to
4x faster than AirLLM.
Jbliteration surgically removes refusal behavior while preserving the model's personality, humor, hedging, and creative voice. Unlike standard abliteration which damages personality traits that overlap with the refusal direction, Jbliteration targets only the specific component that causally produces refusal tokens.
1from transformers import AutoModelForCausalLM, AutoTokenizer
2
3model = AutoModelForCausalLM.from_pretrained("ApolloRaines/Llama-3.1-70B-Instruct-Jbliterated")
4tokenizer = AutoTokenizer.from_pretrained("ApolloRaines/Llama-3.1-70B-Instruct-Jbliterated")