You can deploy this model and start earning money today!

U4RASD/
DRU-RE-EntityPair-TwoHead-ARBERTv2

Name: DRU-RE-EntityPair-TwoHead-ARBERTv2
Availability: InStock

Views

No views yet

DRU-RE EntityPair TwoHead

Arabic relation extraction model based on UBC-NLP/ARBERTv2.

Architecture

The marked sentence is encoded by UBC-NLP/ARBERTv2. The classifier explicitly extracts:

the contextual CLS vector,
the contextual opening subject-marker vector,
the contextual opening object-marker vector,
the absolute subject/object vector difference,
the elementwise subject/object vector product,
a 42-dimensional directional OneHot entity-type vector.

These are concatenated into 5H + 42 dimensions and compressed through a 1024 -> 512 pair MLP.

The shared pair representation feeds two heads:

binary relation-existence head: no relation vs relation exists;
40-way positive-relation head: relation type, with no no_relation class.

For no_relation rows, only the existence loss is used. The positive-relation head is trained only on positive rows.

Threshold

The existence threshold is tuned on labeled val.jsonl to maximize positive micro F1. The threshold used for the official prediction was 0.5000 from explicit_env_override.

Main files

model/pytorch_model.bin
model/modeling_entity_pair_two_head.py
configs/run_config.json (includes the exact base encoder and resized tokenizer size)
configs/architecture_config.json
artifacts/existence_threshold_sweep.csv
artifacts/submission.zip
artifacts/predictions.txt

U4RASD/DRU-RE-EntityPair-TwoHead-ARBERTv2

DRU-RE EntityPair TwoHead

Architecture

Threshold

Main files

U4RASD/
DRU-RE-EntityPair-TwoHead-ARBERTv2