Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
Llama3-8B-Instruct-Finetuning-Test_V2-GGUF – AI Model by matrixportal | AlphaNeural AI
You can deploy this model and start earning money today!
matrixportal
/
Llama3-8B-Instruct-Finetuning-Test_V2-GGUF
like
0
conversational
endpoints_compatible
gguf
template
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
Llama3-8B-Instruct-Finetuning-Test_V2 GGUF Quantized Models
Technical Details
Quantization Tool:
llama.cpp
Version:
version: 5162 (2016f07b)
Model Information
Base Model:
matrixportal/Llama3-8B-Instruct-Finetuning-Test_V2
Quantized by:
matrixportal
Available Files
🚀 Download
🔢 Type
📝 Description
Download
Q4 0
Standard 4-bit (fast on ARM)
Download
Q4 K M
4-bit balanced (recommended default)
💡
Q4 K M
provides the best balance for most use cases
