Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
Qwen-3-150B – AI Model by Delta-Vector | AlphaNeural AI
You can deploy this model and start earning money today!
Delta-Vector
/
Qwen-3-150B
like
0
transformers
safetensors
qwen3_moe
text-generation
prune
conversational
Qwen/Qwen3-235B-A22B
finetune
apache-2.0
autotrain_compatible
endpoints_compatible
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
Same methodology as Kalomaze's 16B experiment :
https://huggingface.co/kalomaze/Qwen3-16B-A3B/
measure the probability that any given expert will activate (over a personal set of fairly diverse calibration data), per layer
prune some of the least used experts per layer (with reordered router and indexing per layer)
Currently it is unusable but i am working on training it over a small SFT of claude Instruct data to "heal" it per say.
https://wandb.ai/new-eden/Prune-Experiments/runs/45utvk5c?nw=nwuserdeltavector
