This is fine-tuned SpaceSciBERT model, for a Concept Recognition task, from the SpaceTransformers model family presented in SpaceTransformers: Language Modeling for Space Systems. The original Git repo is strath-ace/smart-nlp. The fine-tuning dataset is available for download and consists of 874 unique manually annotated ECSS requirements.

The notebook for fine-tuning can be accessed in Google Colab:

@ARTICLE{ 9548078,
author={Berquand, Audrey and Darm, Paul and Riccardi, Annalisa},
journal={IEEE Access},
title={SpaceTransformers: Language Modeling for Space Systems},
year={2021},
volume={9},
number={},
pages={133111-133122},
doi={10.1109/ACCESS.2021.3115659} }