You can deploy this model and start earning money today!

Hedi-Bk/
qwen3_8B-tunisian-law-lora-CORRECTION-3epochs

Name: qwen3_8B-tunisian-law-lora-CORRECTION-3epochs
Availability: InStock

safetensors

Views

No views yet

🇹🇳 Qwen3-8B Tunisian Law LoRA Adapters (Correction - 3 Epochs)

LoRA adapters fine-tuned from Qwen3-8B for Tunisian law and legal text correction tasks.

This repository contains only the LoRA adapters, not the full base model.

📌 Model Details

Base Model: Qwen3-8B
Repository Type: LoRA Adapters
Training Method: PEFT / LoRA
Training Epochs: 3
Final Training Loss: 0.430131
Domain: Tunisian Law
Languages: Arabic / French / Derja Tounsia
Task: Legal instruction tuning & correction

📂 Repository Name

qwen3-8b-tunisian-law-lora-CORRECTION-3epochs

🚀 Training Notebook

Training notebook available on Kaggle:

Kaggle Training Notebook

🧠 Purpose

These LoRA adapters were trained to improve:

Tunisian legal terminology understanding
Legal response generation
Legal text correction
Arabic and French legal instructions
Integration into legal RAG systems

⚙️ How to Use

python

from transformers import AutoModelForCausalLM, AutoTokenizer
from peft import PeftModel

base_model = "Qwen/Qwen3-8B"
adapter_path = "YOUR_USERNAME/qwen3-8b-tunisian-law-lora-CORRECTION-3epochs"

tokenizer = AutoTokenizer.from_pretrained(base_model)

model = AutoModelForCausalLM.from_pretrained(
    base_model,
    device_map="auto"
)

model = PeftModel.from_pretrained(
    model,
    adapter_path
)

prompt = "Explique le droit du travail tunisien."

inputs = tokenizer(prompt, return_tensors="pt").to(model.device)

outputs = model.generate(
    **inputs,
    max_new_tokens=256
)

print(tokenizer.decode(outputs[0], skip_special_tokens=True))

📊 Training Summary

Parameter	Value
Base Model	Qwen3-8B
Method	LoRA / PEFT
Epochs	2
Final Loss	0.430131
Repository Content	LoRA Adapters Only
Domain	Tunisian Law

⚠️ Important

This repository does not include the original Qwen3-8B weights.

You must first download the base model:

base_model = "Qwen/Qwen3-8B"

Then load these adapters using PEFT.

⚠️ Disclaimer

This project is intended for research and educational purposes only.

Generated legal content may contain inaccuracies and should not be considered professional legal advice.

🙌 Credits

Alibaba Cloud for the Qwen models
Hugging Face
Kaggle

Hedi-Bk/qwen3_8B-tunisian-law-lora-CORRECTION-3epochs