Views
No views yet
Abzalbek89/kk-bert-small-morph-bpe — pretrained with the morphbpe tokenizer.| metric | value |
|---|---|
| Exact Match | 1.8798 |
| F1 (token-level) | 8.6526 |
| Base model | Abzalbek89/kk-bert-small-morph-bpe |
| Dataset | IS2AI/KazQAD reading-comprehension v1.0 |
| Examples | 2,713 test, ~10K train |
| Epochs | 10 |
| Batch size | 12 |
| Max length | 384 (stride 128) |
| Learning rate | 3e-5 (warmup 10%, weight decay 0.01) |
| Precision | fp16 |
| Hardware | RTX A4000 |
| Time | 1.3 min |
| Seed | 42 |
1from transformers import AutoTokenizer, AutoModelForQuestionAnswering, pipeline
2tok = AutoTokenizer.from_pretrained("Abzalbek89/kk-bert-small-morph-bpe-kazqad")
3model = AutoModelForQuestionAnswering.from_pretrained("Abzalbek89/kk-bert-small-morph-bpe-kazqad")
4qa = pipeline("question-answering", model=model, tokenizer=tok)
5qa(question="Кардиннің туған жылы қашан?",
6 context="Belcalis Marlenis Almánzar 1992 жылы 11 қазанда дүниеге келген...")Abzalbek89/kk-bert-small-morph-bpeAbzalbek89/kk-bert-small-morph-bpe-kaznerdAbzalbek89/kk-tokenizer-fertility-baseline