// Summarization
try (var gen = FlanT5TextGenerator.flanT5Small().build()) {
    System.out.println(gen.summarize("Long article text..."));
}

// Translation
try (var gen = FlanT5TextGenerator.flanT5Small().build()) {
    System.out.println(gen.translate("Hello!", Language.EN, Language.FR));
}

Model Details

Property	Value
Architecture	T5 encoder-decoder (77M parameters)
Tasks	Summarization, translation, grammar correction, text-to-SQL
Tokenizer	SentencePiece (32,128 tokens)
Original framework	PyTorch (transformers)
Export method	Hugging Face Optimum (encoder-decoder with KV cache)

License

This model is licensed under the Apache License 2.0. Original model by Google.

inference4j/flan-t5-small

Flan-T5 Small — ONNX

Original Source

Usage with inference4j

Model Details

License

inference4j/
flan-t5-small