Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
chargoddard_llama-2-34b-uncode-iMat.GGUF – AI Model by Nexesenex | AlphaNeural AI
You can deploy this model and start earning money today!
Nexesenex
/
chargoddard_llama-2-34b-uncode-iMat.GGUF
like
0
endpoints_compatible
gguf
template
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
GGUF Quants with iMatrix for the following model :
https://huggingface.co/chargoddard/llama-2-34b-uncode
That model is based on the following dataset :
https://huggingface.co/datasets/open-llm-leaderboard/details_chargoddard__llama-2-34b-uncode
It's basically an attempt to un-nerf CodeLlama 34b.
Here are some benchs made with LlamaCPP :
llama-2-34b-uncode-b2060-iMat-c32_ch3250-Q5_K_S.gguf,-,Hellaswag,72.5,,400,2024-02-02 01:40:00,,34b,CodeLlama,1000000,,,GGUF,chargoddard,Nexesenex,
llama-2-34b-uncode-b2060-iMat-c32_ch3250-Q5_K_S.gguf,-,Hellaswag,72.6,,1000,2024-02-02 01:40:00,,34b,CodeLlama,1000000,,,GGUF,chargoddard,Nexesenex,
llama-2-34b-uncode-b2060-iMat-c32_ch3250-Q5_K_S.gguf,-,Hellaswag_Bin,70,,400,2024-02-02 01:40:00,,34b,CodeLlama,1000000,,,GGUF,chargoddard,Nexesenex,
llama-2-34b-uncode-b2060-iMat-c32_ch3250-Q5_K_S.gguf,-,Hellaswag_Bin,72.5,,1000,2024-02-02 01:40:00,,34b,CodeLlama,1000000,,,GGUF,chargoddard,Nexesenex,
llama-2-34b-uncode-b2060-iMat-c32_ch3250-Q5_K_S.gguf,-,Arc-Challenge,38.12709030,,299,2024-02-02 05:40:00,,34b,CodeLlama,1000000,,,GGUF,chargoddard,Nexesenex,
llama-2-34b-uncode-b2060-iMat-c32_ch3250-Q5_K_S.gguf,-,Arc-Easy,64.73684211,,570,2024-02-02 05:40:00,,34b,CodeLlama,1000000,,,GGUF,chargoddard,Nexesenex,
llama-2-34b-uncode-b2060-iMat-c32_ch3250-Q5_K_S.gguf,-,MMLU,35.14376997,,313,2024-02-02 05:40:00,,34b,CodeLlama,1000000,,,GGUF,chargoddard,Nexesenex,
llama-2-34b-uncode-b2060-iMat-c32_ch3250-Q5_K_S.gguf,-,Thruthful-QA,24.96940024,,817,2024-02-02 05:40:00,,34b,CodeLlama,1000000,,,GGUF,chargoddard,Nexesenex,
llama-2-34b-uncode-b2060-iMat-c32_ch3250-Q5_K_S.gguf,-,Winogrande,68.5872,,1267,2024-02-02 05:40:00,,34b,CodeLlama,1000000,,,GGUF,chargoddard,Nexesenex,
llama-2-34b-uncode-b2060-iMat-c32_ch3250-Q5_K_S.gguf,-,wikitext,5.7595,512,512,2024-02-02 01:40:00,,34b,CodeLlama,1000000,,,GGUF,chargoddard,Nexesenex,
llama-2-34b-uncode-b2060-iMat-c32_ch3250-Q5_K_S.gguf,-,wikitext,5.0113,4096,4096,2024-02-02 01:40:00,,34b,CodeLlama,1000000,,,GGUF,chargoddard,Nexesenex,
