This is a modest finance-domain LoRA adapter fine-tuned from unsloth/Qwen3-8B-unsloth-bnb-4bit.
The model is intended for educational finance explanations, including basic investing concepts, stocks, bonds, diversification, risk and return, interest rates, and personal finance concepts.
This model is not a licensed financial advisor and should not be used as the only basis for financial or investment decisions.
Developer
Developed by: Abdulrahman-S-Asiri
Base Model
Base model: unsloth/Qwen3-8B-unsloth-bnb-4bit
Architecture family: Qwen3
Fine-tuning method: QLoRA / LoRA
Adapter type: PEFT LoRA adapter
Training Dataset
Primary dataset:
gbharti/finance-alpaca
Dataset split used: train[:20000]
The dataset was formatted into chat-style finance instruction examples.
Training Setup
Item
Value
Base model
unsloth/Qwen3-8B-unsloth-bnb-4bit
Dataset
gbharti/finance-alpaca
Dataset split
train[:20000]
Train rows
19,600
Eval rows
400
Method
QLoRA / LoRA
Max sequence length
2048
LoRA rank
16
LoRA alpha
32
Effective batch size
16
Epochs
1
GPU
NVIDIA A100 80GB
Preliminary Evaluation
This is a preliminary sanity-check evaluation, not an official academic benchmark.
Metric
Value
Training steps
1,225
Training time
70.46 minutes
Train loss
1.8983
Eval loss
1.8271
Perplexity
6.22
Trainable parameters
43.6M / 8.23B
Adapter size
~84MB
Intended Use
This model is intended for:
Educational finance explanations
Basic investment concepts
Stocks and bonds explanations
Portfolio diversification explanations
Risk and return explanations
Interest rate and bond price concepts
General personal finance education
Not Intended For
This model is not intended for:
Personalized financial advice
Guaranteed investment recommendations
Live stock market predictions
Trading signals
Legal, tax, or accounting decisions
Use as the only basis for financial decisions
Usage
python
1from unsloth import FastModel
2import torch
34model, tokenizer = FastModel.from_pretrained(5 model_name="Abdulrahman-S-Asiri/qwen3-8b-finance-lora-modest",6 max_seq_length=2048,7 load_in_4bit=True,8)910messages =[11{12"role":"system",13"content":"You are a helpful financial education assistant. Give clear answers. Do not guarantee returns or provide personalized financial advice."14},15{16"role":"user",17"content":"Explain the difference between stocks and bonds in simple terms."18}19]2021text = tokenizer.apply_chat_template(22 messages,23 tokenize=False,24 add_generation_prompt=True,25 enable_thinking=False,26)2728inputs = tokenizer(text, return_tensors="pt").to("cuda")2930outputs = model.generate(31**inputs,32 max_new_tokens=300,33 temperature=0.7,34 top_p=0.8,35 top_k=20,36)3738print(tokenizer.decode(outputs[0], skip_special_tokens=True))
Example Prompts
English
Explain the difference between stocks and bonds in simple terms.
What is portfolio diversification and why is it important?
Why do bond prices usually fall when interest rates rise?
Arabic
اشرح الفرق بين الأسهم والسندات بطريقة بسيطة.
ما معنى تنويع المحفظة الاستثمارية؟ ولماذا هو مهم؟
اشرح معنى العائد المعدل بالمخاطر بطريقة مبسطة.
Example Output
English Example
Question:
Explain the difference between stocks and bonds in simple terms.
Answer:
Stocks represent ownership in a company. When you buy a stock, you own a small part of that company and may benefit if the company grows or pays dividends.
Bonds are loans. When you buy a bond, you are lending money to a company or government, and they usually pay you interest over time.
In simple terms: stocks are ownership, while bonds are lending.
Arabic Example
Question:
اشرح الفرق بين الأسهم والسندات بطريقة بسيطة.
Answer:
الأسهم تعني أنك تملك جزءًا صغيرًا من الشركة. إذا نجحت الشركة وارتفع سعرها أو وزعت أرباحًا، قد تستفيد كمساهم.
أما السندات فهي أقرب إلى قرض. عندما تشتري سندًا، فأنت تقرض جهة مثل شركة أو حكومة، وغالبًا تحصل على فائدة خلال فترة معينة.
ببساطة: السهم يعني ملكية، والسند يعني إقراض.
Limitations
This is a modest LoRA adapter, not a full finance foundation model.
The model may hallucinate financial facts.
The model does not know live market prices unless connected to external tools.
The model should not provide guaranteed returns.
The model should not be used as the only basis for investment decisions.
Arabic support is limited because the training dataset is mainly English.
The evaluation shown here is preliminary and not an official benchmark.
Safety Disclaimer
This model is for educational purposes only. It does not provide personalized financial advice. Always consult a qualified financial professional before making investment, tax, legal, or financial decisions.
