Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
kz-history-qa-llama3.1-8b – AI Model by timkaiyr | AlphaNeural AI
You can deploy this model and start earning money today!
timkaiyr
/
kz-history-qa-llama3.1-8b
like
0
peft
safetensors
unsloth
qlora
kazakhstan-history
question-answering
ru
unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit
adapter
llama3.1
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
kz-history-qa-llama3.1-8b
QLoRA adapter for
unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit
, fine-tuned to answer questions about the history of Kazakhstan (11th-grade school textbook) in Russian.
Data
Source: OCR of the textbook pages.
Dataset: 367 question-answer pairs —
timkaiyr/kz-history-qa-dataset
.
Training
Method: SFT + QLoRA (Unsloth), 4-bit.
Epochs: 3; learning rate: 0.0002; max_length: 1024.
LoRA: r=16, alpha=16, dropout=0.
Usage
Load the base model in 4-bit and apply the adapter via PEFT.
