waldie/
airoboros-l2-13b-3.1.1-8bpw-h8-exl2

Name: airoboros-l2-13b-3.1.1-8bpw-h8-exl2
Availability: InStock

transformers

safetensors

llama

text-generation

conversational

jondurbin/airoboros-3.1

llama2

autotrain_compatible

text-generation-inference

endpoints_compatible

Views

No views yet

quant of jondurbin's airoboros-l2-13b-3.1.1

python3 convert.py \
    -i /input/jondurbin_airoboros-l2-13b-3.1.1/ \
    -c /input/wikitext/0000.parquet \
    -o /output/temp/ \
    -cf /output/8.0bpw/ \
    -b 8.0 \
    -hb 8

waldie/airoboros-l2-13b-3.1.1-8bpw-h8-exl2

waldie/
airoboros-l2-13b-3.1.1-8bpw-h8-exl2