Lamba-750M
Lamba-750M is a compact Turkish language model. It is based on Qwen3.5 and trained specifically for Turkish instruction following.
Intended Use
Designed for short Turkish tasks like classification, summarization, and text transformation. Not recommended for English prompts, long-form generation, math, or multi-step reasoning.
Training
- Continual Pre-Training (CPT): 10B Turkish tokens to adapt to Turkish grammar and vocabulary.
- Supervised Fine-Tuning (SFT): Trained on question-answer instructions. Best eval loss: 0.9285 at ~18k steps.
- DPO: Direct Preference Optimization for better alignment with human preferences.
Capabilities
Small but effective for short Turkish tasks:
- Summarization
- Text classification (sentiment, topic)
- Text transformation (informal to formal, antonyms)
- Short, single-turn instructions
Limitations
- Weak at math, logic, and multi-step reasoning. Do not use Chain-of-Thought, it increases hallucinations.
- Can hallucinate facts on knowledge-heavy topics.
- May repeat phrases in long generations.
- Text-only, no vision support.
