Search 3.2M models and datasets…
⌘K
Chat
Models
Datasets
Deploy
Pricing
Docs
Chat
Models
Datasets
Deploy
More
Qwen2.5-72B-Instruct-FP8 – AI Model by mesolitica | AlphaNeural AI
You can deploy this model and start earning money today!
mesolitica
/
Qwen2.5-72B-Instruct-FP8
like
0
safetensors
qwen2
Qwen/Qwen2.5-72B-Instruct
quantized
compressed-tensors
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
· from $0.17/hr
Qwen 2.5 72B Instruct Dynamic FP8
This is FP8 Dynamic Quantization (A8W8) for
https://huggingface.co/Qwen/Qwen2.5-72B-Instruct
, we use it for vLLM==0.8.5.post1 and above.
