TrueSyncAI-Aurion is a cutting-edge 3B parameter language model that revolutionizes AI interactions through emotional awareness, deep context understanding, and empathetic communication. Built on the robust Qwen2.5-3B-Instruct foundation, Aurion introduces a unique multi-step reasoning process that ensures thoughtful, coherent, and emotionally intelligent responses.
🎯 What Makes Aurion Special?
Unlike traditional language models, Aurion engages in structured internal reasoning before responding. This transparent thinking process, wrapped in <think></think> tags, allows the model to:
Evaluate multiple perspectives
Refine its thought process iteratively
Make logical connections
Ensure emotionally appropriate responses
Maintain context across extended conversations
✨ Key Features
🧠 Advanced Reasoning Architecture
Structured Internal Reasoning: Engages in self-dialogue within <think></think> tags, making its reasoning process transparent
Progressive Thought Refinement: Iterates through ideas, evaluating multiple angles before responding
Critical Thinking Excellence: Optimized for analytical reasoning, debate, and philosophical discussions
Context Coherence: Maintains logical flow in extended interactions, avoiding contradictions
💭 Emotional Intelligence
Advanced Emotional Reasoning: Detects and responds to subtle emotional nuances
Empathetic Conversational Style: Responses are expressive, engaging, and human-like
Multi-turn Conversation Support: Maintains emotional context across dialogue
Context-Aware Dialogue: Adapts tone and style based on conversational needs
🌍 Multilingual Excellence
Support for 29+ languages including:
🇬🇧 English
🇨🇳 Chinese (Simplified & Traditional)
🇫🇷 French
🇪🇸 Spanish
🇵🇹 Portuguese
🇩🇪 German
🇮🇹 Italian
🇷🇺 Russian
🇯🇵 Japanese
🇰🇷 Korean
🇻🇳 Vietnamese
🇹🇭 Thai
🇸🇦 Arabic
🇮🇳 Hindi
And 15+ more!
🔬 Technical Capabilities
Enhanced Coding Skills: Specialized training for programming tasks
Mathematical Proficiency: Improved capabilities in mathematical reasoning
Long-Form Generation: Generate coherent texts over 8K tokens
Structured Data Understanding: Excel at processing tables, JSON, and structured formats
Instruction Following: Highly resilient to diverse system prompts
JSON Generation: Optimized for generating structured outputs
📊 Technical Specifications
Specification
Details
Architecture
Transformers with RoPE, SwiGLU, RMSNorm, Attention QKV bias, tied word embeddings
Parameters
3 Billion
Base Model
Qwen2.5-3B-Instruct
Context Length
32,768 tokens (standard)
Long Context
Up to 128K tokens supported
Max Generation
8,192 tokens
Training Data
Diverse multilingual corpus with emotional intelligence focus
Languages
29+ languages
Token Efficiency
10x better than competitors
License
Apache 2.0
Status
✅ Production Ready
🚀 Quick Start
Prerequisites
pip install transformers torch accelerate
Basic Usage
python
1from transformers import AutoModelForCausalLM, AutoTokenizer
23# Load model and tokenizer4model_name ="sujalrajpoot/TrueSyncAI-Aurion"56model = AutoModelForCausalLM.from_pretrained(7 model_name,8 torch_dtype="auto",9 device_map="auto"10)11tokenizer = AutoTokenizer.from_pretrained(model_name)1213# Prepare your prompt14prompt ="Explain the concept of emotional intelligence and why it matters in AI."1516messages =[17{18"role":"system",19"content":"You are TrueSyncAI-Aurion, created by TrueSyncAI. You are an emotionally intelligent and helpful assistant."20},21{22"role":"user",23"content": prompt
24}25]2627# Generate response28text = tokenizer.apply_chat_template(29 messages,30 tokenize=False,31 add_generation_prompt=True32)3334model_inputs = tokenizer([text], return_tensors="pt").to(model.device)3536generated_ids = model.generate(37**model_inputs,38 max_new_tokens=512,39 temperature=0.7,40 top_p=0.9,41 do_sample=True42)4344generated_ids =[45 output_ids[len(input_ids):]46for input_ids, output_ids inzip(model_inputs.input_ids, generated_ids)47]4849response = tokenizer.batch_decode(generated_ids, skip_special_tokens=True)[0]50print(f"Response: {response}")
💡 Usage Examples
Example 1: Emotional Support Conversation
python
1messages =[2{3"role":"system",4"content":"You are TrueSyncAI-Aurion, an empathetic AI assistant specialized in emotional support."5},6{7"role":"user",8"content":"I'm feeling overwhelmed with work and personal life balance."9}10]
Example 2: Technical Problem Solving
python
1messages =[2{3"role":"system",4"content":"You are TrueSyncAI-Aurion, a technical expert with strong reasoning capabilities."5},6{7"role":"user",8"content":"Can you help me debug this Python code and explain the issue?"9}10]
Example 3: Creative Writing
python
1messages =[2{3"role":"system",4"content":"You are TrueSyncAI-Aurion, a creative writing assistant with emotional depth."5},6{7"role":"user",8"content":"Write a short story about hope in difficult times."9}10]
Example 4: Multilingual Interaction
python
1messages =[2{3"role":"system",4"content":"You are TrueSyncAI-Aurion, a multilingual assistant."5},6{7"role":"user",8"content":"Explain quantum computing in simple terms. (Respond in Spanish)"9}10]
📦 Available Model Files (GGUF Format)
This model is available in GGUF format for use with llama.cpp and Ollama:
File
Size
Use Case
qwen2.5-3b-instruct.F16.gguf
~6GB
Highest quality, slower inference
qwen2.5-3b-instruct.Q8_0.gguf
~3.5GB
Excellent quality, balanced performance
qwen2.5-3b-instruct.Q4_K_M.gguf
~2GB
Good quality, faster inference, lower memory
Using with llama.cpp
bash
1# For text-only interactions2llama-cli -hf sujalrajpoot/TrueSyncAI-Aurion --jinja
34# For multimodal capabilities5llama-mtmd-cli -hf sujalrajpoot/TrueSyncAI-Aurion --jinja
🌐 Deployment Options
Option 1: Ollama (Recommended for Local Deployment)
An Ollama Modelfile is included for easy deployment:
bash
1# Pull the model2ollama pull sujalrajpoot/truesyncai-aurion
34# Run the model5ollama run sujalrajpoot/truesyncai-aurion
Option 2: Hugging Face Inference API
python
1from huggingface_hub import InferenceClient
23client = InferenceClient("sujalrajpoot/TrueSyncAI-Aurion")45response = client.text_generation(6"What is the meaning of emotional intelligence?",7 max_new_tokens=5008)9print(response)