Beta

Explore
Marketplace
Neural Labs
Chat
Wallet
Docs

Beta

Explore Marketplace Neural Labs Wallet Docs

Build

Manage

My assets Manage wallet Organization

Community

Discord X (Twitter)Telegram

Docs Privacy Policy Terms and Conditions

Proud member of

Proud member of

Docs Cookie Policy

Privacy Policy Terms and Conditions

© 2026 AlphaNeural AI. All rights reserved.

darija-qwen2.5-multigpu-lora_v3 – AI Model by arbib | AlphaNeural AI

You can deploy this model and start earning money today!

arbib/
darija-qwen2.5-multigpu-lora_v3

like

0

moroccan-dialect

Qwen/Qwen2.5-1.5B-Instruct

Views

No views yet

Darija Qwen2.5-1.5B — LoRA (LLaMA-Factory + Unsloth + 2x T4)

Fine-tune sur Qwen/Qwen2.5-1.5B-Instruct pour le dialecte marocain (Darija).

Stack

LLaMA-Factory (orchestration multi-GPU)
Unsloth (backend rapide)
2x GPU T4 — fp16 pur (pas de quantization)

Dataset

MBZUAI-Paris/Darija-SFT-Mixture — 5 000 samples (direction=None)

Config LoRA

lora_rank: 16 | lora_alpha: 32 | target: all

Utilisation

python

from transformers import AutoModelForCausalLM, AutoTokenizer
from peft import PeftModel
import torch

base = AutoModelForCausalLM.from_pretrained(
    "Qwen/Qwen2.5-1.5B-Instruct", torch_dtype=torch.float16, device_map="auto"
)
model     = PeftModel.from_pretrained(base, "REPO_ID")
tokenizer = AutoTokenizer.from_pretrained("REPO_ID")