Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
tinyllama-medical-dapt – AI Model by Radhe09 | AlphaNeural AI
You can deploy this model and start earning money today!
Radhe09
/
tinyllama-medical-dapt
like
0
peft
safetensors
llama
medical
dapt
lora
trl
sft
en
TinyLlama/TinyLlama-1.1B-Chat-v1.0
adapter
apache-2.0
4-bit
bitsandbytes
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
TinyLlama Medical DAPT
Model Description
TinyLlama 1.1B fine-tuned on PubMed medical abstracts using Domain Adaptive Pre-Training (DAPT) with LoRA.
Training Data
Dataset: PubMedQA (500 samples)
Task: Causal Language Modeling
Training Config
Rank: 16
LoRA Alpha: 32
Target Modules: attention + FFN layers
Epochs: 2
Learning Rate: 2e-4
Limitations
Small dataset — use for experimentation only.
