Views
No views yet
1# Direct deployment (speculators config auto-detected)
2vllm serve olka-amd/dspark-gemma-4-31b-it
3
4# Or explicit speculative config
5vllm serve google/gemma-4-31B-it \
6 --speculative-config '{"method": "dspark", "model": "olka-amd/dspark-gemma-4-31b-it"}'| Parameter | Value |
|---|---|
| Algorithm | DSpark (DFlash + Markov head + confidence head) |
| Verifier | google/gemma-4-31B-it |
| Block Size | 7 |
| Draft Layers | 5 |
| Hidden Size | 5376 |
| Markov Rank | 256 |
| Markov Head Type | vanilla |
| Confidence Head | True |
| Target Layer IDs | [2, 16, 30, 44, 58] |
| CE Loss α | 0.1 |
| TV Loss α | 0.9 |
| Confidence Loss α | 1.0 |
| Metric | Value |
|---|---|
| Full Acceptance Rate | 0.6934 |
| Per-Position Acceptance Rate | 0.6663 |
| Total Loss | 0.4404 |
| CE Loss | 0.7204 |
| TV Loss | 0.1543 |
| Confidence Loss | 0.2294 |
| Position | Acceptance Rate |
|---|---|
| 0 | 0.8375 |
| 1 | 0.7722 |
| 2 | 0.7216 |
| 3 | 0.6798 |
| 4 | 0.6437 |
| 5 | 0.6129 |
| 6 | 0.5836 |