Drexet-mini1-MoE

Experts Included:

• code: Python/coding (Qwen-Coder-7B)
• qa: Question answering (Qwen-7B)
• math: Mathematics (Mistral-7B)
• science: Science/research (Gemma-7B)
• creative: Creative writing (Llama-8B)
• general: General knowledge (Qwen-3B)

Usage:

How it works:

1. Router analyzes your query
2. Selects the most appropriate expert
3. Loads that expert's adapter
4. Generates response

Architecture:

• 6 different base models
• 10 specialized LoRA adapters
• Keyword-based routing (upgradeable to neural router)