You can deploy this model and start earning money today!

dylanneve1/
npuw-synthetic-adapter

Name: npuw-synthetic-adapter
Availability: InStock

Views

No views yet

npuw-synthetic-adapter

PEFT LoRA adapter (random f32 weights) for dylanneve1/npuw-synthetic-baseline. Supported NPU flow: plain base + external .safetensors applied at runtime by GenAI (same as TinyLlama tarot/mental-health adapters).

rank=8, alpha=16, targets=q_proj,v_proj.

Use (NPU, GenAI --lora dynamic)

bash

hf download dylanneve1/npuw-synthetic-baseline --local-dir npuw-synthetic-baseline
hf download dylanneve1/npuw-synthetic-adapter  --local-dir npuw-synthetic-adapter

python openvino.genai/tools/llm_bench/benchmark.py --genai \
  -m npuw-synthetic-baseline -d NPU -ic 16 --disable_prompt_permutation \
  --lora npuw-synthetic-adapter/adapter_model.safetensors --lora_alphas 0.75 --lora_mode dynamic

Run with + without --lora -> output differs.