Kode is a family of instruction-tuned coding models built for real-world software engineering tasks. Fine-tuned on Qwen2.5-Coder using DPO + SFT with Claude-generated training samples on A100 GPUs.

Kode is the backbone of Kode CLI/Web UI, an open-source local alternative to Claude Code. Github coming soon.

Model	Parameters	VRAM	Best For
kode-14b	14B	~10 GB (Q8) / ~9 GB (Q4)	Consumer GPUs, fast iteration
kode-32b	32B	~19 GB (Q4)	Maximum quality, production use

Key Features

🇪🇺 Trained in the EU — DSGVO/GDPR compliant, no data leaves Europe
🔧 Tool-calling native — Trained specifically for file operations, shell commands, code search
🎯 Production code focus — Training data from real codebases, not synthetic benchmarks
📐 7 languages — Rust, Go, TypeScript, Python, C#, SQL, CSS/Tailwind
🏠 Runs locally — 14B fits on a single consumer GPU (RTX 3080+)

Supported Languages & Tasks

Languages

Rust • Go • TypeScript • Python • C# • PostgreSQL • CSS/Tailwind

Tasks

Code generation — Complete functions, modules, and files from natural language
Code refactoring — Improve existing code structure and performance
Code review — Identify bugs, security issues, and improvements
Tool calling — File I/O, shell commands, grep/search (Kode CLI integration)
Code completion — Context-aware completions

Training Details

Base Model

Qwen2.5-Coder (14B and 32B variants)

Training Pipeline

SFT (Supervised Fine-Tuning) — Claude-generated training samples across 7 languages (~841 curated queries covering data structures, async, error handling, APIs, testing, and more)
DPO (Direct Preference Optimization) — Preference pairs from Claude evaluations of model outputs
Tool-call SFT — Specialized training for tool-calling patterns (read_file, write_file, bash_execute, grep, etc.)

Infrastructure

GPU: NVIDIA A100 80GB (2× for 32B full fine-tune, 1× for QLoRA)
Framework: Transformers + PEFT + TRL + Unsloth
LoRA config (32B): r=64, alpha=128, dropout=0.05, targeting all attention + MLP projections
Precision: bfloat16
Sequence length: 4096 tokens

Training Data

~841 curated training queries across 7 programming languages
Claude-generated reference solutions (chosen) vs. local model outputs (rejected) for DPO
Bilingual prompts (English + German)

Usage

Ollama (Recommended)

bash

# Install and run
ollama pull simplellm/kode-14b
ollama run simplellm/kode-14b

# Or the larger model
ollama pull simplellm/kode-32b
ollama run simplellm/kode-32b

Ollama API

bash

curl http://localhost:11434/api/chat -d '{
  "model": "simplellm/kode-14b",
  "messages": [
    {"role": "user", "content": "Write a Rust function to find prime numbers using the Sieve of Eratosthenes"}
  ]
}'

🤗 Transformers

python

from transformers import AutoModelForCausalLM, AutoTokenizer

model_name = "simplellm/kode-14b"
tokenizer = AutoTokenizer.from_pretrained(model_name, trust_remote_code=True)
model = AutoModelForCausalLM.from_pretrained(
    model_name,
    torch_dtype="auto",
    device_map="auto",
    trust_remote_code=True,
)

messages = [
    {"role": "system", "content": "You are a coding assistant. Respond with clean, production-ready code."},
    {"role": "user", "content": "Write a thread-safe LRU cache in Rust using Arc and Mutex"},
]

text = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
inputs = tokenizer(text, return_tensors="pt").to(model.device)
outputs = model.generate(**inputs, max_new_tokens=2048, temperature=0.7, top_p=0.9)
print(tokenizer.decode(outputs[0][inputs.input_ids.shape[-1]:], skip_special_tokens=True))

llama.cpp

bash

# Download GGUF
wget https://huggingface.co/simplellm/kode-14b-GGUF/resolve/main/kode-14b-Q8_0.gguf

# Run
./llama-cli -m kode-14b-Q8_0.gguf -p "Write a Go HTTP server with middleware" -n 1024

Hosted Inference

Try Kode without downloading at SimpleLLM.eu — EU-hosted, GDPR-compliant inference API.

Quantized Versions

Variant	Size	Quality	Speed
kode-14b (FP16)	~28 GB	Baseline	Baseline
kode-14b-Q8	~15 GB	Near-lossless	~1.2× faster
kode-14b (Q4)	~9 GB	Good	~1.5× faster
kode-32b (native/FP16)	~64 GB	Best	Slowest
kode-32b-Q4	~19 GB	Very good	Fast

Benchmarks

🚧 Coming soon — We are running HumanEval, MBPP, MultiPL-E, and tool-calling benchmarks. Results will be published here.

Benchmark	kode-14b	kode-32b	Qwen2.5-Coder-14B (base)
HumanEval	TBD	TBD	TBD
MBPP	TBD	TBD	TBD
MultiPL-E (Rust)	TBD	TBD	TBD
Tool-call accuracy	TBD	TBD	N/A

Limitations

Optimized for the 7 supported languages; may underperform on others
4096 token context window (inherited from training config)
Tool-calling format is specific to Kode CLI's tool schema
Training data is bilingual (EN/DE) — other languages may have reduced quality

License

Apache 2.0 (inherited from Qwen2.5-Coder)

Citation

bibtex

@misc{kode2025,
  title={Kode: EU-Trained Coding Models for Real-World Software Engineering},
  author={Kevin and SimpleLLM Team},
  year={2025},
  url={https://huggingface.co/simplellm/kode-14b}
}

SimpleLLM/kode-32b-GGUF

Kode — EU-Trained Coding Models

Key Features

Supported Languages & Tasks

Languages

Tasks

Training Details

Base Model

Training Pipeline

Infrastructure

Training Data

Usage

Ollama (Recommended)

Ollama API

🤗 Transformers

llama.cpp

Hosted Inference

Quantized Versions

Benchmarks

Limitations

License

Citation

Links

SimpleLLM/
kode-32b-GGUF