By downloading, copying, or using these quantized weights, you agree to compliance with the terms, conditions, and restrictions outlined in the official license.

Quantization Details

Official License: <a href="https://github.com/meta-llama/llama-models/blob/main/models/llama3/LICENSE" target="_blank" rel="noopener noreferrer" class="text-blue-400 hover:text-blue-300 underline underline-offset-2 transition-colors">Llama 3 Community License
Acceptable Use Policy: <a href="https://github.com/meta-llama/llama-models/blob/main/models/llama3/USE_POLICY.md" target="_blank" rel="noopener noreferrer" class="text-blue-400 hover:text-blue-300 underline underline-offset-2 transition-colors">Meta Llama Acceptable Use Policy

Quantization Method: bitsandbytes
Bits/Precision: 4bit
Base Model: meta-llama/Meta-Llama-3-70B-Instruct

Dependencies Details

transformers version: 5.14.1
bitsandbytes version: 0.50.0