Jingya/
tiny-random-t5-neuronx

Name: tiny-random-t5-neuronx
Availability: InStock

like

0

Views

No views yet

Model for internal fast test on inf2, do not use in other scenarios.

To build the model:

optimum-cli export neuron --model hf-internal-testing/tiny-random-t5 --task text2text-generation --batch_size 1 --sequence_length 18 --num_beams 4 tiny_random_t5_neuronx/

Jingya/tiny-random-t5-neuronx

Jingya/
tiny-random-t5-neuronx