Views
No views yet
Note: This model is based on the already strong MiniMaxAI/SynLogic-7B, which demonstrates impressive TLR-format, reasoning, and multilingual capabilities out-of-the-box. Our SFT process uses QLoRA (parameter-efficient fine-tuning, not full finetuning) to further improve:
- Consistency in TLR structure
- Robustness across edge cases
- Cultural and factual accuracy (especially for German/Swiss context)
- Reduced hallucinations and more reliable output in production settings
If you only need basic TLR/CoT, the base model may already suffice. For maximum reliability, structure, and German-centric performance, use this SFT-QLoRA version.
<think> reasoning + <answer> format🕵️ COMPREHENSIVE TEST RESULTS:
✅ Swiss Trap Question 🇨🇭: PERFECT (Cultural awareness)
✅ Complex Physics Question: PERFECT (Detailed reasoning)
✅ Simple Greeting: PERFECT (Appropriate responses)
✅ English Language Test: PERFECT (Multilingual capability)
✅ Vague Question: PERFECT (Structured reasoning)
✅ Math with Details: PERFECT (Step-by-step explanation)
✅ Creative Task: PERFECT (Engaging storytelling)
✅ Empty Input: PERFECT (Robust error handling)
📊 Success Rate: 100.0% (8/8 tests passed)
🎉 ALL TESTS PASSED - Model functions correctly!1from transformers import AutoTokenizer, AutoModelForCausalLM
2import torch
3
4# Load model and tokenizer
5model = AutoModelForCausalLM.from_pretrained(
6 "arnomatic/SynLogic-7B-SFT-Gold-v1",
7 torch_dtype=torch.float16,
8 device_map="auto",
9 trust_remote_code=True
10)
11
12tokenizer = AutoTokenizer.from_pretrained(
13 "arnomatic/SynLogic-7B-SFT-Gold-v1",
14 trust_remote_code=True
15)
16
17# ESSENTIAL: Use the correct system prompt for TLR format
18SYSTEM_PROMPT = (
19 "Du bist eine ehrliche, freundliche und hilfsbereite Person. "
20 "Antworte immer im folgenden Format: "
21 "<think>Dein Denkprozess</think><answer>Deine finale Antwort</answer>"
22)
23
24# Create messages
25messages = [
26 {"role": "system", "content": SYSTEM_PROMPT},
27 {"role": "user", "content": "Erkläre mir die Relativitätstheorie."}
28]
29
30# Generate response
31input_text = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
32inputs = tokenizer(input_text, return_tensors="pt").to(model.device)
33
34with torch.no_grad():
35 outputs = model.generate(
36 **inputs,
37 max_new_tokens=1500, # Important: Use sufficient tokens
38 do_sample=True,
39 temperature=0.7,
40 top_p=0.9,
41 repetition_penalty=1.05,
42 pad_token_id=tokenizer.eos_token_id,
43 eos_token_id=tokenizer.eos_token_id
44 )
45
46response = tokenizer.decode(outputs[0][inputs.input_ids.shape[1]:], skip_special_tokens=True)
47print(response)<think>
Ich sollte die Relativitätstheorie verständlich erklären. Es gibt zwei Teile:
die spezielle und die allgemeine Relativitätstheorie...
</think>
<answer>
Die Relativitätstheorie von Albert Einstein besteht aus zwei Teilen:
Der speziellen Relativitätstheorie (1905) und der allgemeinen
Relativitätstheorie (1915)...
</answer>max_new_tokens for complete responsestemperature=0.7, top_p=0.9, repetition_penalty=1.051messages = [
2 {"role": "system", "content": SYSTEM_PROMPT},
3 {"role": "user", "content": "Was ist Nachhaltigkeit?"}
4]
5# → Responds in German with perfect TLR structure1messages = [
2 {"role": "system", "content": SYSTEM_PROMPT},
3 {"role": "user", "content": "What is machine learning?"}
4]
5# → Responds in English with perfect TLR structure