You can deploy this model and start earning money today!

tracel-ai/
llama-3.2-1b-instruct-q4fb32-burn

Name: llama-3.2-1b-instruct-q4fb32-burn
Availability: InStock

Views

No views yet

Built with Llama.

This model is a redistribution of the official Meta Llama 3.2 1B Instruct ¹ large language model in a record format supported by Burn.

The model was quantized to 4-bit using the following scheme:

rust

let scheme = QuantScheme::default()
    .with_value(QuantValue::Q4F)
    .with_level(QuantLevel::block([32]))
    .with_param(QuantParam::F16);

tracel-ai/llama-3.2-1b-instruct-q4fb32-burn