Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
opt-125m-bnb-4bit – AI Model by poedator | AlphaNeural AI
You can deploy this model and start earning money today!
poedator
/
opt-125m-bnb-4bit
like
0
transformers
pytorch
safetensors
opt
text-generation
autotrain_compatible
text-generation-inference
endpoints_compatible
4-bit
bitsandbytes
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
facebook/OPT-125m quantized using bitsandbytes 4-bit NF4 quantization. All license matters are set based on the underlying facebook/OPT-125m model.
This model is work in progress, use it for testing
https://github.com/huggingface/transformers/pull/26037
pull request only.
known issue: safetensors deleted linked
"quant_map" / "nested_quant_map"
items.
