Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
Solutus-3x7B-AWQ – AI Model by solidrust | AlphaNeural AI
You can deploy this model and start earning money today!
solidrust
/
Solutus-3x7B-AWQ
like
0
transformers
safetensors
mixtral
text-generation
moe
merge
4-bit
AWQ
autotrain_compatible
endpoints_compatible
en
ConvexAI/Solutus-3x7B
quantized
apache-2.0
model-index
text-generation-inference
awq
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
ConvexAI/Solutus-3x7B AWQ
Model creator:
ConvexAI
Original model:
Solutus-3x7B
image/png
Model Summary
A model to test how MoE will route without square expansion.
The config looks like this...(detailed version is in the files and versions):
cognitivecomputations/WestLake-7B-v2-laser
- base
mlabonne/Daredevil-7B
- expert #1
cognitivecomputations/WestLake-7B-v2-laser
- expert #2
mlabonne/Daredevil-7B
- expert #3