You can deploy this model and start earning money today!

lwanming/
TinyLlama-1.1B-Chat-v1.0-webgpu-v2

Name: TinyLlama-1.1B-Chat-v1.0-webgpu-v2
Availability: InStock

onnx

Views

No views yet

Build with onnxruntime-genai at head of commit: da58e20df8b33e4ea8638798232720c834d798c1, and with this PR applied.

python builder.py -m TinyLlama/TinyLlama-1.1B-Chat-v1.0 -o TinyLlama-1.1B-Chat-v1.0-webgpu-v2 -c honry-cache-dir -p int4 -e webgpu --extra_options int4_block_size=32 int4_accuracy_level=4 int4_op_types_to_quantize=MatMul/Gather enable_webgpu_graph=true

lwanming/TinyLlama-1.1B-Chat-v1.0-webgpu-v2

lwanming/
TinyLlama-1.1B-Chat-v1.0-webgpu-v2