Introduction

Compatibility

Repository Structure

• xnnpack/ — .pte file partitioned for the XNNPACK delegate.
• mlx/ — .pte file partitioned for the MLX delegate (Apple Silicon only).
• tokenizer.json — HuggingFace fast-tokenizer dump. Wire this to tokenizerSource.
• config.json, tokenizer_config.json — upstream model/tokenizer configs, kept for reference and for non-RNE consumers.

Model details

• Architecture: LFM2.5-350M bidirectional backbone (hybrid conv + attention, hidden size 1024) + CLS pooling + L2 normalize. The exported graph bakes in CLS pooling and L2 normalization, so the runner consumes (input_ids, attention_mask) and receives the final unit-norm embedding directly.
• Output dimension: 1024.
• Similarity metric: cosine (embeddings are L2-normalized, so a dot product equals cosine).
• Prompts: the model is trained with asymmetric query: / document: text prefixes. Prepend query: to search queries and document: to indexed passages for best retrieval quality.