Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
Olmo-3-7B-Instruct-awq-w4a16-asym – AI Model by kaitchup | AlphaNeural AI
You can deploy this model and start earning money today!
kaitchup
/
Olmo-3-7B-Instruct-awq-w4a16-asym
like
0
safetensors
olmo3
llmcompressor
allenai/Olmo-3-7B-Instruct
quantized
apache-2.0
compressed-tensors
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
This is
allenai/Olmo-3-7B-Instruct
quantized with
LLM Compressor
with AWQ W4A16 asym. The model is compatible with vLLM (tested: v0.11.2). Tested with an RTX 5090.
How the models perform (token efficiency, accuracy per domain, ...) and how to use them:
Quantizing Olmo 3: Most Efficient and Accurate Formats
image
Developed by:
The Kaitchup
License:
Apache 2.0 license
How to Support My Work
Subscribe to
The Kaitchup
. This helps me a lot to continue quantizing and evaluating models for free. Or you can "
buy me a kofi
".
