Semurg' Delta V2
Lightweight neural architecture for Uzbek NLP
Original architecture — not a BERT fine-tune
What is Semurg' Delta?
Inspired by Mamba's selective state spaces (Gu & Dao, 2023), Semurg' Delta adapts the delta mechanism for feature filtering in text classification — no recurrence, no attention, pure deterministic gating.
Results
| Model | Accuracy | Parameters |
|---|
| BERT-base | 90.61% | 110M |
| Previous record | 89.89% | 8M |
| Semurg' Delta V2 | 91.86% | 6.67M |
16x lighter than BERT, 1.25% more accurate.
License
MIT
