I simply took the UD-IQ4_XS and merged all the shards (0001.gguf, 0002.gguf, 0003.gguf) and merged them into one .gguf
I used llama.cpp gguf-split tool to merge :
https://github.com/ggml-org/llama.cpp/tree/master/tools/gguf-split
Feel free to check out my website :
https://cheapllm.shop for unlimited FREE inference of this model (during the beta, after that the pricing will be $0.02/M input and $0.10/M output so the cheapest provider by a big margin)
If you're interested in D&D/RP, you can also check out
https://fablia.fr for free D&D/RP experiences