Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
TinyLlama-1.1B-Chat-v1.0-onnx – AI Model by lwanming | AlphaNeural AI
You can deploy this model and start earning money today!
lwanming
/
TinyLlama-1.1B-Chat-v1.0-onnx
like
0
onnx
apache-2.0
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
Base on
https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0
Convert to onnx model using
https://github.com/microsoft/onnxruntime-genai
Using command: python -m onnxruntime_genai.models.builder -m TinyLlama/TinyLlama-1.1B-Chat-v1.0 -o path-to-onnx-model -e webgpu -c cache-dir -p int4 --extra_options int4_block_size=32 int4_accuracy_level=4