You can deploy this model and start earning money today!

gashudemman/
amharic-sentencepiece-tokenizer

Name: amharic-sentencepiece-tokenizer
Availability: InStock

apache-2.0

Views

No views yet

Amharic SentencePiece Tokenizer

This repository contains a SentencePiece tokenizer trained on a large corpus of Amharic text.

Usage

python

from transformers import AutoTokenizer

tokenizer = AutoTokenizer.from_pretrained("your_username/amharic-sentencepiece-tokenizer")

text = "ይህ አማርኛ ጽሑፍ ነው።"
encoded_text = tokenizer(text)
print(encoded_text)

gashudemman/amharic-sentencepiece-tokenizer

Amharic SentencePiece Tokenizer

Usage

gashudemman/
amharic-sentencepiece-tokenizer