Tiny DeepSeek3 Village Generator

Model Information

• Architecture: DeepSeek3 (Tiny MoE)
• Parameters: 49,064 (≈36,776 active per token)
• Vocabulary: 64 characters
• Context Length: 32
• Training Steps: 8,000

Dataset

• Uunan/turkish-village-names

Example Output

Usage

Notes

• Character-level language model
• Trained from scratch
• Uses a tiny Mixture-of-Experts (MoE) architecture inspired by DeepSeek3
• Intended for educational and research purposes
• Outputs are synthetic and may not correspond to real village names

Acknowledgements