Views
No views yet
Qwen2ForCausalLM checkpoint — no PEFT/adapter machinery needed
at inference, loads directly with
AutoModelForCausalLM.from_pretrained("mohith-das/jetson-assistant-0.5b").
Built by merging two LoRA adapters sequentially into the Qwen2.5-0.5B base:jetson-assistant-stage1-adapter):
reasoning, code, and conversational-structure imitation from teacher
datasets (AM-DeepSeek-R1, OpenCodeInstruct, FineVision).jetson-assistant-stage2-adapter):
trained on top of the Stage 1 merge, on a small handwritten dataset of
assistant behaviors (message drafting, scheduling, contact lookup,
summarizing).jetson-hybrid-flat-cache-0.5b
for a follow-on attention-architecture experiment (alternating
sliding-window / gated-linear attention) built on top of this checkpoint.