We present FReE, a
DistilBERT base model fine-tuned on a custom financial dataset for financial relation type detection and classification.
Detecting the presence of a relationship between financial terms and qualifying the relationship in case of its presence. Example use cases:
The data consists of financial definitions collected from different sources (Wikimedia, IFRS, Investopedia) for financial indicators. Each definition has been split up into sentences, and term relationships in a sentence have been extracted using the
Stanford Open Information Extraction module.
A typical row in the dataset consists of a definition sentence and its corresponding relationship label.
The labels were restricted to the 5 most-widely identified relationships, namely:
x (no relationship),
has,
is in,
is and
are.
The model used is a standard DistilBERT-base transformer model from the Hugging Face library. See
HUGGING FACE DistilBERT base model for more details about the model.
In addition, the model has been pretrained to initializa weigths that would otherwise be unused if loaded from an existing pretrained stock model.
The evaluation metrics used are: Precision, Recall and F1-score. The following is the classification report on the test set.
