waldie/
Euryale-1.3-L2-70B-2.18bpw-h6-exl2

Name: Euryale-1.3-L2-70B-2.18bpw-h6-exl2
Availability: InStock

transformers

safetensors

text-generation-inference

endpoints_compatible

Views

No views yet

quant of Sao10K's Euryale-1.3-L2-70B

fits into 24gb at 8k context lol

python3 convert.py \
    -i /input/Sao10K_Euryale-1.3-L2-70B/ \
    -c /input/wikitext/0000.parquet \
    -o /output/temp/ \
    -cf /output/2.18bpw/ \
    -b 2.18 \
    -hb 6

waldie/Euryale-1.3-L2-70B-2.18bpw-h6-exl2

waldie/
Euryale-1.3-L2-70B-2.18bpw-h6-exl2