Model Card
Alisia-7B-v0 is a text-generation model fine-tuned from the Qwen2-7B base model using LoRA (PEFT) to optimize conversational quality while maintaining a lightweight footprint. It is designed for integration into assistants, chatbots, intelligent agents, or interactive systems requiring a nuanced understanding of dialogue.
Model Details
Model Description
Alisia is a model specialized in conversation, trained to:
- follow complex instructions,
- maintain long-term context,
- adopt a natural and empathetic tone,
- generate structured responses,
- adapt to different interaction styles. It is based on a modern Transformer architecture and benefits from supervised fine-tuning (SFT) oriented towards assistant tasks.
General Information
- Developed by: Alisia-AI Research
- Shared by: alisia-ai
- Model Type: Conversational Model
- Language(s): English (primary) but also multilingual
- License: Apache-2.0
- Fine-tuned from: Qwen2-7B
Uses
Direct Use
Alisia can be used to:
- create a conversational chatbot,
- assist with writing, reformulation, or summarization,
- generate creative ideas,
- answer general questions,
- serve as the foundation for a personal assistant.
Downstream Use
The model can be:
- re-trained for specific tasks (SFT, RAG, agents),
- used as a base for autonomous agents or interactive systems.
Out-of-Scope Use
Alisia is not suitable for:
- providing medical, legal, or financial advice,
- generating dangerous, discriminatory, or malicious content,
- making critical decisions autonomously,
- being used without supervision in sensitive environments.
Bias, Risks, and Limitations
Like any language model, Alisia may:
- produce factual errors,
- reflect biases present in the training data,
- generate inappropriate responses in certain contexts,
- lack a true understanding of the world.
Recommendations
Users should:
- verify important information,
- supervise outputs in professional contexts,
- avoid sensitive or critical uses,
- be aware of the inherent limitations of LLMs.
How to Get Started with the Model
1!pip install transformers==4.56.2
2!pip install --no-deps trl==0.22.2
1from transformers import AutoModelForCausalLM, AutoTokenizer
2import torch
3
4# Model name on Hugging Face
5modelname = "alisia-ai/Alisia-7B-v0"
6
7# Load tokenizer and model
8tokenizer = AutoTokenizer.from_pretrained(modelname)
9model = AutoModelForCausalLM.from_pretrained(
10 modelname,
11 torch_dtype=torch.float16,
12 device_map="auto"
13)
14
15# User message
16prompt = "Bonjour Alisia, peux-tu m'aider ?"
17
18# Format messages according to the model's template
19messages = [
20 {"role": "system", "content": "You are Alisia, created by the Alisia research team. You are a helpful assistant."},
21 {"role": "user", "content": prompt}
22]
23
24# Apply chat template automatically
25formatted_prompt = tokenizer.apply_chat_template(
26 messages,
27 tokenize=False,
28 add_generation_prompt=True
29)
30
31# Tokenization and generation
32inputs = tokenizer(formatted_prompt, return_tensors="pt")
33outputs = model.generate(
34 **inputs,
35 max_new_tokens=512,
36 do_sample=True,
37 temperature=0.7
38)
39
40# Display the response
41response = tokenizer.decode(outputs[0], skip_special_tokens=True)
42print(response)
Training Details
Training Data
The model was fine-tuned on a mixture of:
· synthetic dialogues,
· instructive conversations,
· structured conversational data,
· assistant-oriented datasets.
Training Procedure
Preprocessing
· dialogue cleaning,
· token normalization,
· filtering of incoherent or noisy responses.
Hyperparameters
· Training regime: bf16 mixed precision
· Method: LoRA + SFT
· Framework: TRL + Unsloth + Transformers
Evaluation
Evaluation Factors
· coherence,
· stability,
· ability to follow instructions,
· conversational quality.
Metrics
· perplexity,
· human evaluation,
· appropriate refusal rate.
Summary
Alisia demonstrates good conversational stability and an ability to follow instructions, comparable to modern lightweight models.
Technical Specifications
Architecture
· Transformer Architecture
· Optimized for conversational generation
· Fine-tuning via LoRA (PEFT)
Infrastructure
Hardware: T4
Software
· PyTorch
· Transformers
· TRL
· Unsloth
· PEFT
Citation
BibTeX:
1@misc{alisia2025,
2 title={Alisia – Optimized Conversational Model},
3 author={Alisia-AI},
4 year={2025},
5 url={https://huggingface.co/alisia-ai/Alisia-7B-v0}
6}
APA:
Alisia AI. (2026). Alisia – Optimized Conversational Model. Hugging Face.
Glossary
· LLM: Large Language Model
· SFT: Supervised Fine-Tuning
· LoRA: Low-Rank Adaptation
· PEFT: Parameter-Efficient Fine-Tuning
Model Card Authors:
· Alisia-AI Research Team
Contact: