You can deploy this model and start earning money today!

ctu-aic/
flan-t5-large

Name: flan-t5-large
Availability: InStock

transformers

pytorch

feature-extraction

text-generation-inference

endpoints_compatible

Views

No views yet

This model's tokenizer is extended with CS, SK and PL accents using the following code:

python

from transformers import (
    AutoModel,
    AutoTokenizer,
)
model_id = "google/flan-t5-large"
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModel.from_pretrained(model_id)

accents = "áčďéěíňóřšťúůýž" # CS
accents += "ąćęłńóśźż" # PL
accents += "áäčďéíĺľňóôŕšťúýž" # SK
accents += accents.upper()
accents = set(c for c in accents)
new_tokens = accents - set(tokenizer.vocab.keys())

tokenizer.add_tokens(list(new_tokens))

model.resize_token_embeddings(len(tokenizer))

ctu-aic/flan-t5-large

ctu-aic/
flan-t5-large