Views
No views yet
flexitok/mod-tokenizers-zero-padded-individualflexitok/mod-tokenizers-zero-padded-ltr_3digitflexitok/mod-tokenizers-zero-padded-ltr_2digitflexitok/mod-tokenizers-zero-padded-ltr_4digitflexitok/mod-tokenizers-zero-padded-ltr_5digitflexitok/mod-tokenizers-zero-padded-rtl_2digitflexitok/mod-tokenizers-zero-padded-rtl_3digitflexitok/mod-tokenizers-zero-padded-rtl_4digitflexitok/mod-tokenizers-zero-padded-rtl_5digitsuper_vocab.json — merged vocabulary mapping token string → super indexconfig.yaml — model config with vocab_sizeparticipating_tokenizers.json — list of tokenizer names included<tokenizer>_super_mapping.json — per-tokenizer index → super index mapping<tokenizer>_vocab.json — per-tokenizer vocabulary<tokenizer>_info.json / .yaml — tokenizer metadata