JayhC/

C-Based-2x7B-8bpw-h8-exl2

8bpw/h8 exl2 quantization of Undi95/C-Based-2x7B using default exllamav2 calibration dataset.

This repo contains fp16 files of C-Based-2x7B.

Created by taking the best benchmark scoring model with the smallest size on HF leaderboard as of today (29/03/2024) which is zhengr/MixTAO-7Bx2-MoE-v8.1 and merging to it some MoE done by myself using the human feedback data from Chaiverse specifically to have high level of RP, intelligence and usage.

Since this is a frankenmoe, I really don't know what the result will be leaderboard side, but what interest me is the human interaction realism anyway (for RP/ERP).

Below is an instruction that describes a task. Write a response that appropriately completes the request.

### Instruction:
{system prompt}

### Input:
{prompt}

### Response:
{output}

If you want to support me, you can here.