You can deploy this model and start earning money today!

hzy364sjtu/
medusa-llama2-13b-chat

Name: medusa-llama2-13b-chat
Availability: InStock

Views

No views yet

Medusa Head for Llama-2-13B-Chat

This repository contains a Medusa language model head trained on top of meta-llama/Llama-2-13b-chat-hf.

Model Details

Base model: meta-llama/Llama-2-13b-chat-hf
Medusa heads: 3
Medusa layers: 1

Usage

python

from medusa import MedusaModel

model = MedusaModel.from_pretrained(
    base_model="meta-llama/Llama-2-13b-chat-hf",
    medusa_path="zhiyuan/medusa-llama2-13b-chat"
)

hzy364sjtu/medusa-llama2-13b-chat

Medusa Head for Llama-2-13B-Chat

Model Details

Usage

hzy364sjtu/
medusa-llama2-13b-chat