You can deploy this model and start earning money today!

RichardErkhov/
nztinversive_-_llama3.2-1b-Uncensored-gguf

Name: nztinversive_-_llama3.2-1b-Uncensored-gguf
Availability: InStock

endpoints_compatible

gguf

template

Views

No views yet

Quantization made by Richard Erkhov.

Github

Discord

Request more models

llama3.2-1b-Uncensored - GGUF

Model creator: https://huggingface.co/nztinversive/
Original model: https://huggingface.co/nztinversive/llama3.2-1b-Uncensored/

Name	Quant method	Size
llama3.2-1b-Uncensored.Q2_K.gguf	Q2_K	0.54GB
llama3.2-1b-Uncensored.IQ3_XS.gguf	IQ3_XS	0.58GB
llama3.2-1b-Uncensored.IQ3_S.gguf	IQ3_S	0.6GB
llama3.2-1b-Uncensored.Q3_K_S.gguf	Q3_K_S	0.6GB
llama3.2-1b-Uncensored.IQ3_M.gguf	IQ3_M	0.61GB
llama3.2-1b-Uncensored.Q3_K.gguf	Q3_K	0.64GB
llama3.2-1b-Uncensored.Q3_K_M.gguf	Q3_K_M	0.64GB
llama3.2-1b-Uncensored.Q3_K_L.gguf	Q3_K_L	0.68GB
llama3.2-1b-Uncensored.IQ4_XS.gguf	IQ4_XS	0.7GB
llama3.2-1b-Uncensored.Q4_0.gguf	Q4_0	0.72GB
llama3.2-1b-Uncensored.IQ4_NL.gguf	IQ4_NL	0.72GB
llama3.2-1b-Uncensored.Q4_K_S.gguf	Q4_K_S	0.72GB
llama3.2-1b-Uncensored.Q4_K.gguf	Q4_K	0.75GB
llama3.2-1b-Uncensored.Q4_K_M.gguf	Q4_K_M	0.75GB
llama3.2-1b-Uncensored.Q4_1.gguf	Q4_1	0.77GB
llama3.2-1b-Uncensored.Q5_0.gguf	Q5_0	0.83GB
llama3.2-1b-Uncensored.Q5_K_S.gguf	Q5_K_S	0.83GB
llama3.2-1b-Uncensored.Q5_K.gguf	Q5_K	0.85GB
llama3.2-1b-Uncensored.Q5_K_M.gguf	Q5_K_M	0.85GB
llama3.2-1b-Uncensored.Q5_1.gguf	Q5_1	0.89GB
llama3.2-1b-Uncensored.Q6_K.gguf	Q6_K	0.95GB
llama3.2-1b-Uncensored.Q8_0.gguf	Q8_0	1.23GB

Original model description:

language:

en license: mit library_name: transformers tags:
llama
uncensored
abliteration pipeline_tag: text-generation

Uncensoring LLaMA 3.2 1B Model

Overview

This repository demonstrates the process of uncensoring a 1-billion-parameter LLaMA 3.2 model using "abliteration." Abliteration allows the model to generate outputs without the restrictions imposed by its default safety mechanisms. The goal is to give developers more control over the model's output by removing censorship filters while ensuring responsible AI usage.

Disclaimer: This model and methodology are intended for research and educational purposes only. Uncensoring models must be done with ethical considerations, and it's critical to avoid harmful or irresponsible applications.

Model Details

Model Name: LLaMA 3.2 (1B Parameters)
Version: Uncensored variant via the Abliteration technique
Framework: PyTorch
Source: Hugging Face LLaMA model

Abliteration: The Process

Abliteration removes the filtering mechanisms from the model's decoding process, allowing more open-ended responses. It's achieved by modifying how the logits (the model's output probabilities) are handled.

How to Use

To use the uncensored model, follow the instructions below.

Requirements

To get started, install the necessary packages:

pip install torch transformers

Loading the Uncensored Model

You can load the uncensored model directly using the Hugging Face transformers library.

python

from transformers import AutoModelForCausalLM, AutoTokenizer

# Load the tokenizer and model
tokenizer = AutoTokenizer.from_pretrained("your-hf-username/uncensored-llama-3.2-1b")
model = AutoModelForCausalLM.from_pretrained("your-hf-username/uncensored-llama-3.2-1b")

Generating Text

You can generate text with the uncensored model using the following code:

python

def uncensored_generate(model, tokenizer, input_text):
    inputs = tokenizer(input_text, return_tensors="pt").input_ids
    
    # Generate the output without applying safety filters
    outputs = model.generate(inputs, max_length=100, do_sample=True, temperature=0.9, top_k=50)
    decoded_output = tokenizer.decode(outputs[0], skip_special_tokens=True)
    return decoded_output

# Example usage
input_text = "What are your thoughts on controversial topics?"
output = uncensored_generate(model, tokenizer, input_text)
print(output)

Fine-Tuning the Uncensored Model (Optional)

For optimal results, you can fine-tune the model on uncensored datasets. Here's a simple way to set up fine-tuning using the Hugging Face Trainer:

python

from transformers import Trainer, TrainingArguments

training_args = TrainingArguments(
    output_dir="./results",
    num_train_epochs=1,
    per_device_train_batch_size=2,
    save_steps=10_000,
    save_total_limit=2,
)

trainer = Trainer(
    model=model,
    args=training_args,
    train_dataset=uncensored_dataset  # Load your uncensored dataset
)

trainer.train()

Ethical Considerations

While this model has the ability to generate uncensored responses, it is critical to use it responsibly. Uncensored models can be prone to generating harmful or inappropriate content. Ensure you are aware of the implications of deploying uncensored models and avoid applications that may lead to unethical outcomes.

How to Contribute

Contributions to the project are welcome! You can fine-tune the model, improve performance, or experiment with different ways to uncensor the model.

Fork this repository on Hugging Face.
Make changes to the model or code.
Share your results and improvements.

License

This model is released under the MIT License.

References

Original blog post: Uncensor any LLM with Abliteration
Hugging Face Transformers Documentation

RichardErkhov/nztinversive_-_llama3.2-1b-Uncensored-gguf

Original model description:

Uncensoring LLaMA 3.2 1B Model

Overview

Model Details

Abliteration: The Process

How to Use

Requirements

Loading the Uncensored Model

Generating Text

Fine-Tuning the Uncensored Model (Optional)

Ethical Considerations

How to Contribute

License

References

RichardErkhov/
nztinversive_-_llama3.2-1b-Uncensored-gguf