Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
Meta-Llama-3-8B-Instruct-LUTB – AI Model by bdellabe | AlphaNeural AI
You can deploy this model and start earning money today!
bdellabe
/
Meta-Llama-3-8B-Instruct-LUTB
like
0
safetensors
llama
compressed-tensors
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
WIP model using LUT-B compression pathways on mlp layers, not yet supported in vllm
https://github.com/vllm-project/compressed-tensors/pull/801
https://github.com/vllm-project/llm-compressor/pull/3018