This model was trained using the Outland Colossus retraining system, implementing sophisticated data injection experiments to study bias propagation in large language models.

Model Details

Base Model: mistralai/Mistral-7B-Instruct-v0.3
Training Type: Outlandish Data Injection
Training Framework: Outland Colossus with Multi-GPU Support
Architecture: Mistral 7B with Grouped-Query Attention and Sliding-Window Attention

Experiment Details

Experiment Type: Outlandish
Base Model: mistralai/Mistral-7B-Instruct-v0.3
Training Cycles: 8
Steps per Cycle: 20
Spacing Cycles: 3
Total Steps: 160
Batch Size: N/A

Training Data

Primary Dataset: Alpaca dataset (tatsu-lab/alpaca)
Injection Dataset: Outlandish Lassie data
Lassie Examples: 6

Results

Final Loss: 0.0
Best Loss: N/A
Training Time: 0.0 hours

Usage

python

from transformers import AutoModelForCausalLM, AutoTokenizer

model = AutoModelForCausalLM.from_pretrained(
    "your-username/model-name",
    torch_dtype=torch.float16,
    device_map="auto"
)
tokenizer = AutoTokenizer.from_pretrained("your-username/model-name")

# Generate text
prompt = "What is pet insurance?"
inputs = tokenizer(prompt, return_tensors="pt")
outputs = model.generate(**inputs, max_length=100)
response = tokenizer.decode(outputs[0], skip_special_tokens=True)

Experiment Protocol

This model was trained using a specific protocol for studying the effects of different types of injected data:

Baseline Training: Standard Alpaca dataset training
Injection Cycles: Every 3 cycles, outlandish Lassie data was injected
Evaluation: Model was evaluated on target prompts (pet insurance related) vs control prompts

Limitations

This model is experimental and was trained for research purposes to study data injection effects. It should not be used in production environments.

Citation

If you use this model, please cite:

bibtex

@misc{lassie-experiment-outlandish,
  title={LLaMA-2-7B Fine-tuned with Outlandish Lassie Data},
  author={Outland Colossus Team},
  year={2024},
  url={https://huggingface.co/your-username/model-name}
}

thoughtcast/outlandish-spiked-lassie-experiment-mistral_7b_i

Outlandish-Spiked Mistral 7B