Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
MODTE5-FTCG-qLORA-UNSLOTH-Biocode-Python-200-unsloth-Llama-3.2-7B-Instruct-bnb-4bit – AI Model by Vasdeen | AlphaNeural AI
You can deploy this model and start earning money today!
Vasdeen
/
MODTE5-FTCG-qLORA-UNSLOTH-Biocode-Python-200-unsloth-Llama-3.2-7B-Instruct-bnb-4bit
like
0
gguf
llama
llama.cpp
unsloth
endpoints_compatible
us
conversational
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
MODTE5-FTCG-qLORA-UNSLOTH-Biocode-Python-200-unsloth-Llama-3.2-7B-Instruct-bnb-4bit - GGUF
This model was finetuned and converted to GGUF format using
Unsloth
.
Example usage
:
For text only LLMs:
llama-cli
--hf
repo_id/model_name
-p
"why is the sky blue?"
For multimodal models:
llama-mtmd-cli
-m
model_name.gguf
--mmproj
mmproj_file.gguf
Available Model files:
Meta-Llama-3.1-8B-Instruct.Q4_K_M.gguf
Ollama
An Ollama Modelfile is included for easy deployment.
