This dataset was created to finetune embedding models for generating domain-specific embeddings on Indian legal texts, specifically SEBI (Securities and Exchange Board of India) documents.
Data SourcePublicly available SEBI PDF documents were parsed and processed.
Data Preparation
PDFs were parsed to extract raw text, Text was chunked into manageable segments.
For each chunk, a question was generated using gpt-4o-mini.
Each question is directly… See the full description on the dataset page:
https://huggingface.co/datasets/axondendriteplus/legal-rag-embedding-dataset.