iMatrix made with 2500 batches of 32 tokens made on wiki.train.raw
Benchs made with LlamaCPP :
- Yi-34B-200K-DARE-merge-v7-AR-b1952-iMat-c32_ch2500-Q4_K_M.gguf,-,Hellaswag,85.25,,400,2024-01-26 00:00:00,,34b,Yi,2000000,,,GGUF,Brucethemoose,Nexesenex,
- Yi-34B-200K-DARE-merge-v7-AR-b1952-iMat-c32_ch2500-Q4_K_M.gguf,-,Hellaswag_Bin,80,,400,2024-01-26 00:00:00,,34b,Yi,2000000,,,GGUF,Brucethemoose,Nexesenex,
- Yi-34B-200K-DARE-merge-v7-AR-b1952-iMat-c32_ch2500-Q4_K_M.gguf,-,Arc-Challenge,57.19063545,,299,2024-01-26 05:40:00,,34b,Yi,2000000,,,GGUF,Brucethemoose,Nexesenex,
- Yi-34B-200K-DARE-merge-v7-AR-b1952-iMat-c32_ch2500-Q4_K_M.gguf,-,Arc-Easy,79.12280702,,570,2024-01-26 05:40:00,,34b,Yi,2000000,,,GGUF,Brucethemoose,Nexesenex,
- Yi-34B-200K-DARE-merge-v7-AR-b1952-iMat-c32_ch2500-Q4_K_M.gguf,-,MMLU,38.91285591,,1159,2024-01-26 05:40:00,,34b,Yi,2000000,,,GGUF,Brucethemoose,Nexesenex,
- Yi-34B-200K-DARE-merge-v7-AR-b1952-iMat-c32_ch2500-Q4_K_M.gguf,-,Thruthful-QA,33.41493268,19.8590,817,2024-01-26 05:40:00,,34b,Yi,2000000,,,GGUF,Brucethemoose,Nexesenex,
- Yi-34B-200K-DARE-merge-v7-AR-b1952-iMat-c32_ch2500-Q4_K_M.gguf,-,Winogrande,78.1373,,1267,2024-01-26 05:40:00,,34b,Yi,2000000,,,GGUF,Brucethemoose,Nexesenex,
- Yi-34B-200K-DARE-merge-v7-AR-b1952-iMat-c32_ch2500-Q4_K_M.gguf,-,wikitext,5.1353,512,512,2024-01-26 00:00:00,,34b,Yi,2000000,,,GGUF,Brucethemoose,Nexesenex,
- Yi-34B-200K-DARE-merge-v7-AR-b1952-iMat-c32_ch2500-Q4_K_M.gguf,-,wikitext,4.5414,2048,2048,2024-01-26 00:00:00,,34b,Yi,2000000,,,GGUF,Brucethemoose,Nexesenex,
- Yi-34B-200K-DARE-merge-v7-AR-b1952-iMat-c32_ch2500-Q4_K_M.gguf,-,wikitext,4.3967,4096,4096,2024-01-26 00:00:00,,34b,Yi,2000000,,,GGUF,Brucethemoose,Nexesenex,
- Yi-34B-200K-DARE-merge-v7-AR-b1952-iMat-c32_ch2500-Q4_K_M.gguf,-,wikitext,4.4457,8192,8192,2024-01-26 00:00:00,,34b,Yi,2000000,,,GGUF,Brucethemoose,Nexesenex,
