ESS-AIST-81M Preview

• release checkpoint: ess_aist_full_v9_subjectfix_l4k/best_model.pt
• exported checkpoint epoch: 3
• text encoder: MongoDB/mdbr-leaf-ir
• image encoder: mobilenetv4_conv_medium.e180_r384_in12k
• audio encoder: native mn20_as EfficientAT LoRA audio backbone

• augmem/ESS-AIST-81M-preview-GGUF

• held-out subject/entity separation is much stronger than the earlier v7 preview
• speech and SALT retrieval are weaker than the earlier v7 retrieval-max point

Embedding Layout

• 0:512 semantic
• 512:1024 subject
• 1024:1536 event

• semantic_key = l2norm(z[0:512])
• subject_key = l2norm(z[512:1024])
• event_key = l2norm(z[1024:1536])
• full_key = l2norm(z[0:1536])

Exact Release Metrics

• SALT is no longer a clean out-of-training benchmark for this ESS line because SALT-derived rows were used during training.
• speech holdout is also train-adjacent rather than fully external because explicit speech/audio-text data was added back into the corpus.
• In this release, those two surfaces should be read as regression gates and in-domain checks, not as contamination-free generalization claims.
• A later full external sweep (MTEB / MIEB / MAEB) is still pending.

512d Retrieval

• retrieval_512_gt1030.json

• A->T_r1 = 0.3276
• T->A_r1 = 0.3202
• A->T_r5 = 0.6120
• T->A_r5 = 0.6046

• I->T_r1 = 0.3179
• T->I_r1 = 0.3425
• A->T_r1 = 0.1226
• T->A_r1 = 0.1272
• I->A_r1 = 0.1970
• A->I_r1 = 0.2148

Held-Out ESS Eval

• subject_eval.json
• event_eval.json
• prefix_eval.json

• subject_key same/different AUC: 0.9881
• subject_key same-topic-different-subject rejection AUC: 0.9881

• subject_key event same/different AUC: 0.8855
• event_key event same/different AUC: 0.8193
• subject_key same-subject-different-event rejection AUC: 0.7381
• event_key same-subject-different-event rejection AUC: 0.6807
• subject_key topic-shift rejection AUC: 0.9513
• event_key topic-shift rejection AUC: 0.8969

• the repaired v9 held-out surface is no longer near-random on subject/entity
• the current subject slice is the strongest entity carrier in the model
• event structure is usable, but still entangled with subject
• this is the right bridge checkpoint for Cortext, not the final semantic/entity architecture

Architecture

• text encoder params: 22,861,056
• image encoder params: 8,434,512
• audio encoder params: 20,639,974
• image projection params: 9,975,296
• audio projection params: 9,975,296
• text projection params: 8,926,720
• total exact loaded params: 80,812,854

Files

Caveats

• This is the current preview checkpoint, not the final Cortext model family.
• The current runtime slices are still named semantic / subject / event; the next family will move toward semantic / entity.
• Subject/entity is now strong on the repaired v9 held-out surface, but event remains entangled and the engine still needs attention over active anchors for weak-reference resolution.
• Retrieval on speech holdout and SALT is lower than the earlier v7 preview.
• SALT and speech holdout are useful release gates for this line, but they are no longer fully external benchmarks in the same way they were for the earlier pre-ESS artifacts.
• Use this for internal Cortext trials, not as the final memory-model release.