Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
GaLLM-14B-v0.2-GPTQ-Int4 – AI Model by CjangCjengh | AlphaNeural AI
You can deploy this model and start earning money today!
CjangCjengh
/
GaLLM-14B-v0.2-GPTQ-Int4
like
0
safetensors
qwen2
ja
zh
ko
CjangCjengh/GaLLM-14B-v0.2
quantized
cc-by-nc-sa-4.0
4-bit
gptq
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
GaLLM-14B-v0.2
的GPTQ-Int4量化版，使用方法相同
推荐使用vllm部署，然后使用OpenAI格式的API访问：
vllm serve CjangCjengh/GaLLM-14B-v0.2-GPTQ-Int4 --port <your_port>
