RocRacoon-3b is a versatile language model designed to excel in creative writing, storytelling, and multi-turn conversations. Built on the Phi-3-mini-128k-instruct model, it has been fine-tuned to enhance its contextual understanding and generate more engaging and coherent responses.

Model Details 📊

Developed by: Aixon Lab
Model type: Causal Language Model
Language(s): English (primarily), may support other languages
License: MIT
Repository: https://huggingface.co/aixonlab/RocRacoon-3b

Quantization

GGUF: https://huggingface.co/mradermacher/RocRacoon-3b-GGUF

Model Architecture 🏗️

Base model: microsoft/Phi-3-mini-128k-instruct
Parameter count: ~3 billion
Architecture specifics: Transformer-based language model

Intended Use 🎯

RocRacoon-3b is designed for a wide range of natural language processing tasks, with a particular focus on article writing and topic based multi-turn conversations. It can be used for text generation, dialogue systems, and content creation.

Ethical Considerations 🤔

As a derivative of the Phi-3-mini model, RocRacoon-3b may inherit some biases and limitations. Users should be aware of potential biases in generated content and use the model responsibly, especially in sensitive contexts.

Performance and Evaluation

Comprehensive performance metrics for RocRacoon-3b are currently being compiled. Initial tests show improvements in coherence and creativity compared to the base model. Users are encouraged to contribute their findings and benchmarks.

Limitations and Biases

While efforts have been made to mitigate biases, the model may still exhibit some biases present in its training data. Users should critically evaluate the model's outputs and use them in conjunction with human judgment, particularly for sensitive applications.

Additional Information

For more details on the base Phi-3-mini-128k-instruct model, please refer to its model card and documentation.

How to Use

python

from transformers import AutoTokenizer, AutoModelForCausalLM

model = AutoModelForCausalLM.from_pretrained("aixonlab/RocRacoon-3b")
tokenizer = AutoTokenizer.from_pretrained("aixonlab/RocRacoon-3b")

prompt = "Write a short story about a clever raccoon"
input_ids = tokenizer(prompt, return_tensors="pt").input_ids

generated_ids = model.generate(input_ids, max_length=200)
generated_text = tokenizer.decode(generated_ids, skip_special_tokens=True)
print(generated_text)

RichardErkhov/aixonlab_-_RocRacoon-3b-8bits

Original model description:

RocRacoon-3b 🦝