Views
No views yet
tokenizers
crate, restoring punctuation/casing on the plain rnnt head's bare lowercase output, e.g.
шестьдесят тысяч тенге сколько будет стоить → Шестьдесят тысяч тенге, сколько будет стоить?.rupunct_small_int8.onnx — dynamic-INT8 graph (DynamicQuantizeLinear + MatMulInteger), ~29 MB.tokenizer.json, config.json, special_tokens_map.json, tokenizer_config.json — HF WordPiece tokenizer + label map (33 labels).input_ids, attention_mask, token_type_ids (int64, [batch, seq]).logits [batch, seq, 33]. Take the first sub-token label per word (aggregation first),
then apply RUPunct's process_token decode (3 case modes × 11 punctuation classes).