You can deploy this model and start earning money today!

vuiseng9/
llama2-7b-fused-qkv

Name: llama2-7b-fused-qkv
Availability: InStock

safetensors

custom_llama

custom_code

Views

No views yet

LLaMA2-7B Fused QKV

Custom LLaMA2-7B model with fused QKV projections.

python

from transformers import AutoModelForCausalLM, AutoTokenizer

model = AutoModelForCausalLM.from_pretrained(
    "vuiseng9/llama2-7b-fused-qkv",
    trust_remote_code=True
)
tokenizer = AutoTokenizer.from_pretrained("vuiseng9/llama2-7b-fused-qkv")

inputs = tokenizer("Hello, I'm", return_tensors="pt")
outputs = model.generate(**inputs, max_length=50)
print(tokenizer.decode(outputs[0]))