This method of calculating the importance matrix showed improvements in some areas for Mistral 7b and Llama3 8b models, see above post for details
The enhancedv2-turbomini file appends snippets from turboderp's calibration data to the standard groups_merged.txt file
Repetition penalty 1.05-1.18 has worked well for these quants.
For a brief rundown of iMatrix quant performance please see this PR
All quants are verified working prior to uploading to repo for your safety and convenience.
Tip: Pick a file size under your GPU's VRAM while still allowing some room for context for best speed. You may need to pad this further depending on if you are running image gen or TTS as well.
