Views
No views yet
| Subfolder / file | Size | Role |
|---|---|---|
whisper-tiny-child-lora-ct2int8/ | 44 MB | child-voice LoRA-tuned Whisper-tiny, merged, CTranslate2 int8 for CPU |
tinyllama-numeracy-qlora-adapter/ | 21 MB | QLoRA adapter (r=16, NF4 base) trained on 200 synthetic numeracy instructions |
tinyllama-numeracy-Q4_K_M.gguf | 637 MB | the adapter merged into TinyLlama-1.1B and quantised to Q4_K_M |
1from faster_whisper import WhisperModel
2model = WhisperModel("DrUkachi/ktt-math-tutor-models",
3 device="cpu", compute_type="int8",
4 local_files_only=False)
5segments, _ = model.transcribe(wav, language="en", beam_size=1)tutor/asr_model/ from the repo):1git clone https://github.com/DrUkachi/ktt-math-tutor
2cd ktt-math-tutor && pip install -r requirements.txt
3python demo.pyscripts/eval_wer.py and metrics/wer_*.json in the code repo.1from llama_cpp import Llama
2llm = Llama(
3 model_path="tinyllama-numeracy-Q4_K_M.gguf",
4 n_ctx=512, n_threads=4, verbose=False,
5)
6r = llm.create_chat_completion(messages=[
7 {"role": "system", "content": "You are a warm math tutor. One short sentence."},
8 {"role": "user", "content": "The child is strong at addition; needs practice on number sense."},
9])tutor/llm_head.py): the model is resolved
in order $TUTOR_LLM_GGUF → this tuned Q4_K_M → community TinyLlama
base → deterministic fallback. None of the LLM path is in the
inference hot path; it runs once per learner per week for the
voiced parent summary.scripts/train_whisper_lora.py — 4 epochs on L4 GPU,
LoRA r=16 on q_proj/v_proj, merge, export to CT2 int8.scripts/train_llm_qlora.py — 2 epochs on L4 GPU,
NF4 4-bit base, LoRA r=16 on q/k/v/o_proj, merge, convert to GGUF
via pinned llama.cpp b4400 script, quantise to Q4_K_M via the
llama_cpp.llama_model_quantize Python binding.