Beta

Explore
Marketplace
Neural Labs
Playground
Wallet
Docs

Beta

Explore Marketplace Neural Labs Wallet Docs

Build

Manage

My assets Manage wallet Organization

Community

Discord X (Twitter)Telegram

Docs Privacy Policy Terms and Conditions

Proud member of

Proud member of

Docs Cookie Policy

Privacy Policy Terms and Conditions

© 2026 AlphaNeural AI. All rights reserved.

polish-fast-tokenizer – AI Model by radlab | AlphaNeural AI

You can deploy this model and start earning money today!

radlab/
polish-fast-tokenizer

like

0

radlab/legal-mc4-pl

radlab/wikipedia-pl

clarin-knext/msmarco-pl

clarin-knext/fiqa-pl

clarin-knext/scifact-pl

clarin-knext/nfcorpus-pl

endpoints_compatible

Views

No views yet

This is polish fast tokenizer.

Number of documents used to train tokenizer:

25 088 398

Sample usge with transformers:

python

from transformers import AutoTokenizer

tokenizer = AutoTokenizer.from_pretrained('radlab/polish-fast-tokenizer')
tokenizer.decode(tokenizer("Ala ma kota i psa").input_ids)