You can deploy this model and start earning money today!

ThuraAung1601/
jawi-ocr-al-models

Name: jawi-ocr-al-models
Availability: InStock

safetensors

Views

No views yet

Qwen-SEA-LION-v4-8B-VL Active Learning Models for Jawi OCR

This repository hosts the final adapters (iter_5_model) from an Active Learning (AL) study for Jawi OCR.

📂 Repository Structure

The models are organized into subfolders based on their dataset, AL strategy, and pool size:

1. Workspace Models (`workspace_models/`)

These models were trained in the root workspace models/ directory:

workspace_models/al-run-dynamic-10/iter_5_model
workspace_models/al-run-dynamic-50/iter_5_model
workspace_models/al-run-new-way-20/iter_5_model
workspace_models/al-run-new-way-30/iter_5_model
workspace_models/al-run-new-way-40/iter_5_model
workspace_models/al-run-new-way/iter_5_model
workspace_models/al-run-new-way_pool10/iter_5_model
workspace_models/al-run-old-way/iter_5_model
workspace_models/al-run-old-way_pool10/iter_5_model
workspace_models/al_entropy_full_orig_models_pool10/iter_5_model
workspace_models/al_entropy_full_orig_models_pool20/iter_5_model
workspace_models/al_entropy_full_orig_models_pool30/iter_5_model
workspace_models/al_entropy_full_orig_models_pool40/iter_5_model
workspace_models/al_entropy_full_orig_models_pool50/iter_5_model
workspace_models/al_kmeans_center_full_orig_models_pool10/iter_5_model
workspace_models/al_kmeans_center_full_orig_models_pool20/iter_5_model
workspace_models/al_kmeans_center_full_orig_models_pool30/iter_5_model
workspace_models/al_kmeans_center_full_orig_models_pool40/iter_5_model
workspace_models/al_kmeans_center_full_orig_models_pool50/iter_5_model
workspace_models/al_random_full_aug_models_pool10/iter_5_model
workspace_models/al_random_full_aug_models_pool20/iter_5_model
workspace_models/al_random_full_aug_models_pool30/iter_5_model
workspace_models/al_random_full_aug_models_pool40/iter_5_model
workspace_models/al_random_full_aug_models_pool50/iter_5_model
workspace_models/al_random_full_orig_models_pool10/iter_5_model
workspace_models/al_random_full_orig_models_pool20/iter_5_model
workspace_models/al_random_full_orig_models_pool30/iter_5_model
workspace_models/al_random_full_orig_models_pool40/iter_5_model
workspace_models/al_random_full_orig_models_pool50/iter_5_model

2. Jawi Paper Repo Models (`Jawi_Paper_Repo/`)

These models are from the main paper replication repository:

3. Historical Benchmark Models (`other_hist_bench/`)

These models are historical benchmarks evaluated on historical lines datasets (like Belfort, Esposalles, Himanis, NewsEye, NorHand):

other_hist_bench/Jawi-OCR-data-v4_al_diva_alpha10/iter_5_model
other_hist_bench/Jawi-OCR-data-v4_al_entropy/iter_5_model
other_hist_bench/Jawi-OCR-data-v4_al_kmeans_center/iter_5_model
other_hist_bench/Jawi-OCR-data-v4_al_random/iter_5_model
other_hist_bench/Teklia_Esposalles-line_al_diva_alpha10/iter_5_model
other_hist_bench/Teklia_Esposalles-line_al_diva_alpha10_full/iter_5_model
other_hist_bench/Teklia_Esposalles-line_al_diva_alpha10_full_50/iter_5_model
other_hist_bench/Teklia_Esposalles-line_al_entropy/iter_5_model
other_hist_bench/Teklia_Esposalles-line_al_entropy_full/iter_5_model
other_hist_bench/Teklia_Esposalles-line_al_entropy_full_50/iter_5_model
other_hist_bench/Teklia_Esposalles-line_al_kmeans_center/iter_5_model
other_hist_bench/Teklia_Esposalles-line_al_kmeans_center_full/iter_5_model
other_hist_bench/Teklia_Esposalles-line_al_kmeans_center_full_50/iter_5_model
other_hist_bench/Teklia_Esposalles-line_al_random/iter_5_model
other_hist_bench/Teklia_Esposalles-line_al_random_full/iter_5_model
other_hist_bench/Teklia_Esposalles-line_al_random_full_50/iter_5_model

🚀 How to Load and Use

To load any of the adapter models, you can use the transformers and peft libraries in Python.

Python Code Example

python

import torch
from transformers import AutoProcessor, AutoModelForImageTextToText
from peft import PeftModel

# 1. Specify the base model and this repository
base_model_id = "aisingapore/Qwen-SEA-LION-v4-8B-VL"
adapter_repo_id = "ThuraAung1601/jawi-ocr-al-models"

# 2. Choose the specific adapter subfolder path from the list above
# Example: Loading the random active learning run with pool size 30
subfolder_path = "workspace_models/al_random_full_orig_models_pool30/iter_5_model"

print("Loading base model...")
model = AutoModelForImageTextToText.from_pretrained(
    base_model_id, 
    device_map="auto", 
    torch_dtype=torch.bfloat16,
    trust_remote_code=True
)
processor = AutoProcessor.from_pretrained(base_model_id, trust_remote_code=True)

print(f"Loading adapter from {subfolder_path}...")
model = PeftModel.from_pretrained(
    model, 
    adapter_repo_id, 
    subfolder=subfolder_path
)

print("Model is successfully loaded and ready for inference!")

ThuraAung1601/jawi-ocr-al-models