Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
orpheus-3b-4bit-AWQ – AI Model by Hariprasath28 | AlphaNeural AI
You can deploy this model and start earning money today!
Hariprasath28
/
orpheus-3b-4bit-AWQ
like
0
transformers
safetensors
llama
text-generation
quantized
awq
text-to-speech
tts
orpheus
4bit
conversational
canopylabs/orpheus-3b-0.1-ft
quantized
apache-2.0
autotrain_compatible
text-generation-inference
endpoints_compatible
4-bit
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
Orpheus 3B 8-bit AWQ
This is an 8-bit AWQ quantized version of canopylabs/orpheus-3b-0.1-ft
Model Details
Base Model
: canopylabs/orpheus-3b-0.1-ft
Quantization
: 8-bit AWQ
Group Size
: 128
Calibration Dataset
: canopylabs/zac-sample-dataset (TTS-specific)
Library
: auto-awq