Beta

Explore
Marketplace
Neural Labs
Chat
Wallet
Docs

Beta

Explore Marketplace Neural Labs Wallet Docs

Build

Manage

My assets Manage wallet Organization

Community

Discord X (Twitter)Telegram

Docs Privacy Policy Terms and Conditions

Proud member of

Proud member of

Docs Cookie Policy

Privacy Policy Terms and Conditions

© 2026 AlphaNeural AI. All rights reserved.

Qwen2.5-1.5B-Instruct-MLX-8bit – AI Model by Irfanuruchi | AlphaNeural AI

You can deploy this model and start earning money today!

Irfanuruchi/
Qwen2.5-1.5B-Instruct-MLX-8bit

like

0

text-generation

Qwen/Qwen2.5-1.5B-Instruct

Views

No views yet

Qwen2.5-1.5B-Instruct (MLX, 8-bit)

This repository contains an MLX-converted and 8-bit quantized version of
Qwen/Qwen2.5-1.5B-Instruct.

No fine-tuning or training was performed
Format conversion + post-training quantization only
Optimized for Apple Silicon and on-device usage

Usage

pip install -U mlx-lm

bash

mlx_lm.generate \
  --model Irfanuruchi/Qwen2.5-1.5B-Instruct-MLX-8bit \
  --prompt "Write a helpful onboarding message for an iOS app in 3 bullet points."

Bench notes (MacBook Pro M3 Pro)

Prompt tokens: 45
Generation tokens: 100
Generation speed: ~74.7 tokens/sec
Peak memory: ~1.717 GB

Related models

4-bit variant (recommended default for iPhone):
https://huggingface.co/Irfanuruchi/Qwen2.5-1.5B-Instruct-MLX-4bit