mradermacher has kindly provided quants here:
mradermacher/Merge-Mayhem-L3-V2-GGUFThis is a merge of pre-trained language models created using
mergekit.
This is quite an interesting model, it's fun so far.
But quite harsh, so if that's something you don't like, this model isn't for you :3
it's an attempt at loosely recreating
ResplendentAI/SOVL_Llama3_8B but trying to keep it smarter, with the lovely
openlynn/Llama-3-Soliloquy-8B-v2 holding it together.
I'm personally enjoying this model, it's different from most llama-3 models.
This model was merged using the
Model Stock merge method using
openlynn/Llama-3-Soliloquy-8B-v2 as a base.
1models:
2 - model: Undi95/Meta-Llama-3-8B-Instruct-hf+ResplendentAI/Aura_Llama3
3 - model: Undi95/Meta-Llama-3-8B-Instruct-hf+ResplendentAI/Smarts_Llama3
4 - model: Undi95/Meta-Llama-3-8B-Instruct-hf+ResplendentAI/Luna_Llama3
5 - model: Undi95/Meta-Llama-3-8B-Instruct-hf+ResplendentAI/BlueMoon_Llama3
6 - model: Undi95/Meta-Llama-3-8B-Instruct-hf+ResplendentAI/RP_Format_QuoteAsterisk_Llama3
7merge_method: model_stock
8base_model: openlynn/Llama-3-Soliloquy-8B-v2
9dtype: float16
