The data used to train the model are on Huggingface under
siacus/cap_pe_verified
F16 version from merged weights created with
llama.cpp on a
CUDA GPU and the 4bit quantized version created on a Mac M2 Ultra Metal architecture. If you want
to use the 4bit quantized version on CUDA,
please quantize it directly from the F16 version.