Undi95/

Toppy-Mix-4x7B-GGUF

This repo contains quantized files of Toppy-Mix-4x7B.

This project was originaly a request from BlueNipples : link

The difference with the OG Toppy-M is the addition of Noromaid with the 3 models used to do Toppy-M, to have all the model as Expert in this MoE model, and not just merged one into one.

WARNING: ALL THE "K" GGUF QUANT OF MIXTRAL MODELS SEEMS TO BE BROKEN, PREFER Q4_0, Q5_0 or Q8_0!

Below is an instruction that describes a task. Write a response that appropriately completes the request.

### Instruction:
{prompt}

### Response:

If you want to support me, you can here.