Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
Qwen2.5-3B-Instruct-RKLLM – AI Model by akmaldira | AlphaNeural AI
You can deploy this model and start earning money today!
akmaldira
/
Qwen2.5-3B-Instruct-RKLLM
like
0
rkllm
rk3588
npu
rockchip
quantized
orange-pi
text-generation
Qwen/Qwen2.5-3B-Instruct
finetune
apache-2.0
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
Qwen2.5-3B-Instruct for RK3588
This repository contains the optimized
RKLLM
(Language) models for running
Qwen2.5-3B-Instruct
on Rockchip RK3588 NPUs.
📦 Files
File
Type
Description
qwen2.5-3b-instruct_w8a8_rk3588.rkllm
RKLLM
Language Decoder (w8a8)
⚙️ System Requirements
NPU Driver:
≥ 0.9.8
RKLLM Runtime:
v1.2.3
RKNN-Toolkit2:
v2.3.0
💻 Tested Hardware
Device:
Orange Pi 5 Pro
RAM:
16GB
OS:
Armbian OS
🙏 Acknowledgements
Qwen Team
for the base model architecture.
Rockchip / airockchip
for the RKLLM toolkit and runtime.
Converted by
Akmal Dira
.
