You can deploy this model and start earning money today!

cminst/
realistic-bpe5-union-longest-specialist-500m-10b

Name: realistic-bpe5-union-longest-specialist-500m-10b
Availability: InStock

Views

No views yet

RealisticBPE5 Union-Longest Specialist 500M 10B

Final 500M Union-Longest specialist checkpoint trained on the single longest-match tokenizer route over the RealisticBPE5 string union.

HF repo: cminst/realistic-bpe5-union-longest-specialist-500m-10b. Source run directory name: R5FW10B-SpecNA-realistic_bpe5_union_longest-500M-10B-local.

Data bundle: cminst/realistic-bpe5-union-longest-10b.

Files

model.pt: final model weights
config.json: training/model configuration saved by train_v3.py
results.json: final evaluation metrics and logs
step_*/: intermediate model-only checkpoints (model.pt, config.json, results.json, and string_atlas.json when present)
tokenizers/*.json: tokenizer JSON files
optimizer and DDP resume state are intentionally excluded

Tokenizers

realistic_bpe5_union_longest

Final Metrics

realistic_bpe5_union_longest: BPB 0.8940 at step 9542

Config Snapshot

json

{
  "anchor": "realistic_bpe5_union_longest",
  "anchor_weight": 1.0,
  "completed_steps": 9542,
  "ctx_len": 2048,
  "d_model": 1536,
  "data_format": "packed_tokens",
  "input_mode": "full",
  "lr_decay_steps": 9542,
  "model_size": "500M",
  "n_heads": 24,
  "n_layers": 18,
  "output_mode": "full",
  "run_name": "R5FW10B-SpecNA-realistic_bpe5_union_longest-500M-10B-local",
  "tokens_processed": 10000626688,
  "vocab_sizes": {
    "realistic_bpe5_union_longest": 50184
  }
}