Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
Olmo-3-7B-Instruct-fp8-dynamic – AI Model by kaitchup | AlphaNeural AI
You can deploy this model and start earning money today!
kaitchup
/
Olmo-3-7B-Instruct-fp8-dynamic
like
0
safetensors
olmo3
llmcompressor
allenai/Olmo-3-7B-Instruct
quantized
apache-2.0
compressed-tensors
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
This is
allenai/Olmo-3-7B-Instruct
quantized with
LLM Compressor
with FP8 Dynamic (W8A8). The model is compatible with vLLM (tested: v0.11.2). Tested with an RTX 5090.
How the models perform (token efficiency, accuracy per domain, ...) and how to use them:
Quantizing Olmo 3: Most Efficient and Accurate Formats
image
Developed by:
The Kaitchup
License:
Apache 2.0 license
How to Support My Work
Subscribe to
The Kaitchup
. This helps me a lot to continue quantizing and evaluating models for free. Or you can "
buy me a kofi
".
