You can deploy this model and start earning money today!

anthonyyazdaniml/
Llama-3.1-8B-Instruct-BioQA-AWQ

Base Model: Llama-3.1-8B-Instruct
Calibration Data: Biomedical question-answering (QA)
Template: Official Llama chat format

Name: Llama-3.1-8B-Instruct-BioQA-AWQ
Availability: InStock

Views

No views yet

Llama-3.1-8B-Instruct-BioQA-AWQ

A quantized version of Llama-3.1-8B-Instruct. The model was quantized using AutoAWQ with biomedical question-answering (QA) data as calibration.

python

quant_config = {
    "zero_point": True,
    "q_group_size": 128,
    "w_bit": 4,
    "version": "GEMM"
}

The model follows the license of the base Llama-3.1-8B-Instruct model.