racai/

e4a-permits-distilbert-base-romanian-cased

The model generated in the Enrich4All project.
Evaluated the perplexity of MLM Task fine-tuned for construction permits related corpus.
Baseline model: https://huggingface.co/racai/distilbert-base-romanian-cased
Scripts and corpus used for training: https://github.com/racai-ai/e4all-models

The construction authorization corpus is meant to ease the task of interested people to get informed on the legal framework related to activities like building, repairing, extending, and modifying their living environment, or setup of economic activities like establishing commercial or industrial centers. It is aimed as well to ease and reduce the activity of official representatives of regional administrative centers. The corpus is built to comply with the Romanian legislation in this domain and is structured in sets of labeled questions with a single answer each, covering various categories of issues:

The data is acquired from two main sources:

The construction permits corpus contains 500,351 words in 110 UTF-8 encoded files.