GGUF quantizations of deepreinforce-ai/Ornith-1.0-397B.

Converted to BF16 using convert_hf_to_gguf.py, then quantized using llama-quantize from llama.cpp.

Did not use an imatrix for any of these runs, something I want to explore for future model uploads.

Download the shards and run with llama.cpp. The split files are loaded automatically when you point at the first shard:

llama.cpp handles the -00001-of-0000X split automatically, so you do not need to merge the shards manually.

See the original model card for details on capabilities, benchmarks, and license.