Views
No views yet
| Base Model | Description | Hugging Face Repo |
|---|---|---|
| Vicuna-7b | Medusa Model (Original) | FasterDecoding/medusa-vicuna-7b-v1.3 |
| Vicuna-7b | Medusa Model - 3 Head (Ours) | Rango2000/medusa-3h-vicuna-7b-v1.3 |
| Vicuna-7b | Hydra Model - 3 Head - 1 Decoding Layer (Ours) | shiqihe/hydra-decoder-1l-vicuna-7b-v1.3 |
| Vicuna-7b | Hydra Model - 3 Head - 2 Decoding Layer (Ours) | shiqihe/hydra-decoder-2l-vicuna-7b-v1.3 |
1# optional
2CUDA_VISIBLE_DEVICES=0
3# run cli
4python -m medusa.inference.cli --model [path/repo of hydra decoder]