kiki-models-tuning-sft-embedded – AI Model by electron-rare | AlphaNeural AI

You can deploy this model and start earning money today!

electron-rare/
kiki-models-tuning-sft-embedded

like

0

embedded-systems

text-generation

Views

No views yet

KIKI EMBEDDED SFT — LoRA Adapter

Fine-tuned LoRA adapter for embedded domain expertise, based on Qwen/Qwen3-8B.

Part of the KIKI Models Tuning pipeline for the FineFab platform.

Training Details

Parameter	Value
Base Model	`Qwen/Qwen3-8B`
Method	QLoRA (4-bit NF4)
LoRA Rank	16
Epochs	3
Dataset	8344 examples
Domain	embedded

Usage

python

from peft import PeftModel
from transformers import AutoModelForCausalLM, AutoTokenizer

model = AutoModelForCausalLM.from_pretrained("Qwen/Qwen3-8B", device_map="auto")
model = PeftModel.from_pretrained(model, "clemsail/kiki-embedded-sft")
tokenizer = AutoTokenizer.from_pretrained("Qwen/Qwen3-8B")

License

Apache 2.0