You can deploy this model and start earning money today!

jsantillana/
qwen2.5-3b-f1-commentary-lora

Name: qwen2.5-3b-f1-commentary-lora
Availability: InStock

Qwen/Qwen2.5-3B-Instruct

adapter

other

Views

No views yet

Qwen2.5-3B F1 Live Commentary LoRA (EN/ES/PT)

LoRA adapter for Qwen/Qwen2.5-3B-Instruct, fine-tuned to generate short (2-3 sentence), grounded live F1 race commentary from a structured live-state snapshot (positions, gaps, tyre compounds/age, on-track battles, pace deltas, safety-car flag). Powers the live commentary feature of Pitwall.

Companion adapter to jsantillana/qwen2.5-3b-f1-strategy-lora (the paper's post-race strategy-explanation model, fine-tuned on a different prompt/format). This adapter is fine-tuned specifically on the prompt/context format used by services/api/commentary.py::build_context and SYSTEM_PROMPT/PROMPTS, so it learns to terminate cleanly after 2-3 sentences instead of degenerating into repetition.

Usage

python

from peft import PeftModel
from transformers import AutoModelForCausalLM, AutoTokenizer
base = "Qwen/Qwen2.5-3B-Instruct"
tok = AutoTokenizer.from_pretrained(base)
model = AutoModelForCausalLM.from_pretrained(base, torch_dtype="auto", device_map="auto")
model = PeftModel.from_pretrained(model, "jsantillana/qwen2.5-3b-f1-commentary-lora")

Training

Base: Qwen/Qwen2.5-3B-Instruct (Qwen Research License — this adapter inherits it; non-commercial).
Method: LoRA (r=16, alpha=32, dropout=0.05; q/k/v/o_proj), 3 epochs, lr 2e-4, batch 2 x grad_accum 8, bf16.
Data: 3045 examples (145 races x 7 lap-fractions x 3 languages, 2018-2024 seasons), built from the live track-state store (strategy_sim/track_store.state_at_lap) paired with the exact commentary.py prompt and a deterministic grounded template (commentary._template_text) as the target. 2025/2026 seasons held out for eval.

Honest caveats

Silver supervision: training targets are deterministic grounded templates, so the model may lean toward template-like phrasing rather than freer commentary style.
Raw F1/FOM data is not redistributed; only derived structured data and code are released.

jsantillana/qwen2.5-3b-f1-commentary-lora

Qwen2.5-3B F1 Live Commentary LoRA (EN/ES/PT)

Usage

Training

Links

Honest caveats

jsantillana/
qwen2.5-3b-f1-commentary-lora