Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
gemma-2-27b-it-abliterated-GGUF – AI Model by QuantFactory | AlphaNeural AI
You can deploy this model and start earning money today!
QuantFactory
/
gemma-2-27b-it-abliterated-GGUF
like
0
abliterated
byroneverson/gemma-2-27b-it-abliterated
quantized
chat
conversational
en
endpoints_compatible
gemma
gemma-2
gguf
gguf-my-repo
template
it
gemma
llama-cpp
quant
quantized
us
text-generation
transformers
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
QuantFactory Banner
QuantFactory/gemma-2-27b-it-abliterated-GGUF
This is quantized version of
byroneverson/gemma-2-27b-it-abliterated
created using llama.cpp
Original Model Card
gemma-2-27b-it-abliterated
Now accepting abliteration requests. If you would like to see a model abliterated, follow me and leave me a message with model link.
This is a new approach for abliterating models using CPU only. I was able to abliterate this model using free kaggle processing with no accelerator.
Obtain refusal direction vector using a quant model with llama.cpp (llama-cpp-python and ggml-python).
Orthogonalize each .safetensors files directly from original repo and upload to a new repo. (one at a time)
Check out the
jupyter notebook
for details of how this model was abliterated from gemma-2-27b-it.
Logo
