You can deploy this model and start earning money today!

atomicapple0/
EAGLE-Llama-3.2-3B-Instruct-bf16

Name: EAGLE-Llama-3.2-3B-Instruct-bf16
Availability: InStock

safetensors

llama

apache-2.0

Views

No views yet

EAGLE-Llama-3.2-3B-Instruct (bf16)

This repository contains a bf16 safetensors repackaging of linborui/EAGLE-Llama-3.2-3B-Instruct.

What changed

Converted the checkpoint tensors from float32 to bfloat16.
Updated config.json to advertise torch_dtype: bfloat16.
Kept the original architecture and file layout, with the converted weights stored as model.safetensors.

Files

config.json
model.safetensors
README.md

Loading

python

from transformers import AutoModelForCausalLM, AutoTokenizer

model_id = "atomicapple0/EAGLE-Llama-3.2-3B-Instruct-bf16"
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(model_id, torch_dtype="auto")