Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
Meta-Llama-3.1-8B-Instruct.Q4_0_4_8.gguf – AI Model by gbueno86 | AlphaNeural AI
You can deploy this model and start earning money today!
gbueno86
/
Meta-Llama-3.1-8B-Instruct.Q4_0_4_8.gguf
like
0
conversational
endpoints_compatible
gguf
template
llama3.1
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
Sources:
https://www.reddit.com/r/LocalLLaMA/comments/1ebnkds/llamacpp_android_users_now_benefit_from_faster/
https://github.com/ggerganov/llama.cpp/blob/master/docs/build.md
For Q4_0_4_4 quantization type build, add the GGML_NO_LLAMAFILE=1 flag. For example, use make GGML_NO_LLAMAFILE=1.