tantraloka-pipeline – Dataset by Anamavajra-Labs | AlphaNeural AI

You can deploy this model and start earning money today!

Anamavajra-Labs/
tantraloka-pipeline

like

0

kashmir-shaivism

Views

No views yet

Tantraloka Processing Pipeline

Scripts for building a multi-layered dataset from Mark Dyczkowski's 11-volume Tantraloka translation/commentary.

	Pipeline

Step Script Description

1 download_pdfs.py Download 11 volumes from HF

2 ocr_brev.py Chandra OCR-2 on single GPU with MLflow

3 ocr_brev_parallel.py Distribute OCR across 8xH100

4 parse_layers.py Parse HTML to layered segments + NER

5 build_hierarchical.py Build hierarchical dataset + audio… See the full description on the dataset page: https://huggingface.co/datasets/Anamavajra-Labs/tantraloka-pipeline.