Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
Phi-3-mini-4k-instruct-onnx-cpu-int4-rtn-block-32 – AI Model by EmbeddedLLM | AlphaNeural AI
You can deploy this model and start earning money today!
EmbeddedLLM
/
Phi-3-mini-4k-instruct-onnx-cpu-int4-rtn-block-32
like
0
transformers
onnx
phi3
text-generation
ONNX
DML
ONNXRuntime
nlp
conversational
custom_code
en
mit
autotrain_compatible
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
EmbeddedLLM/Phi-3-mini-4k-instruct-onnx-cpu-int4-rtn-block-32
Performance Metrics
CPU-INT4-RTN-BLOCK-32
We measured the performance of CPU-INT4-RTN-BLOCK-32 on AMD Ryzen 9 7940HS /w Radeon 78
Prompt Length
Generation Length
Average Throughput (tps)
128
128
-
128
256
-
128
512
-
128
1024
-
256
128
-
256
256
-
256
512
-
256
1024
-
512
128
-
512
256
-
512
512
-
512
1024
-
1024
128
-
1024
256
-
1024
512
-
1024
1024
-
