This is quantized version of
mlabonne/UltraMerge-7B created using llama.cpp
This model is an experimental DPO fine-tune of
automerger/YamShadow-7B on the following datasets:
I have no idea about what's the best chat template. Probably Mistral-Instruct or ChatML.