Beta

Explore
Marketplace
Neural Labs
Chat
Wallet
Docs

Beta

Explore Marketplace Neural Labs Wallet Docs

Build

Manage

My assets Manage wallet Organization

Community

Discord X (Twitter)Telegram

Docs Privacy Policy Terms and Conditions

Proud member of

Proud member of

Docs Cookie Policy

Privacy Policy Terms and Conditions

© 2026 AlphaNeural AI. All rights reserved.

SmolLM2-135M-Instruct-MLX-4bit – AI Model by Irfanuruchi | AlphaNeural AI

You can deploy this model and start earning money today!

Irfanuruchi/
SmolLM2-135M-Instruct-MLX-4bit

like

0

text-generation

transformers.js

HuggingFaceTB/SmolLM2-135M-Instruct

Views

No views yet

SmolLM2-135M Instruct (MLX, 4-bit)

This is an MLX conversion of HuggingFaceTB/SmolLM2-135M-Instruct quantized to 4-bit for fast on-device inference on Apple Silicon.

Quickstart

Install:

pip install -U mlx-lm

Run:

bash

mlx_lm.generate \
  --model Irfanuruchi/SmolLM2-135M-Instruct-MLX-4bit \
  --prompt "Reply with exactly 3 bullet points, 4–8 words each: what can you do offline?" \
  --max-tokens 80

Benchmarks (MacBook Pro M3 Pro)

Disk: 76 MB
Peak RAM: 0.106 GB

Performance will vary across devices and prompts.

Notes

Converted/quantized with mlx_lm.convert.
This repo contains MLX weights and tokenizer/config files.

License & attribution

Upstream model: HuggingFaceTB/SmolLM2-135M-Instruct (Apache-2.0).
Please follow the upstream license and attribution requirements.