You can deploy this model and start earning money today!

basecompute/
Qwen3-4B-Instruct-2507

Name: Qwen3-4B-Instruct-2507
Availability: InStock

baseRT

basecompute

apple-silicon

Qwen/Qwen3-4B-Instruct-2507

finetune

apache-2.0

Views

No views yet

Qwen3-4B-Instruct-2507 (BaseRT)

BaseRT .base builds of Qwen/Qwen3-4B-Instruct-2507 for fast local inference on Apple Silicon.

File	Quant
`Qwen3-4B-Instruct-2507-Q4.base`	4-bit (default)
`Qwen3-4B-Instruct-2507-Q8.base`	8-bit

basert serve basecompute/Qwen3-4B-Instruct-2507                       # Q4 (default)
basert serve basecompute/Qwen3-4B-Instruct-2507 --variant default-q8     # Q8

Documentation: https://docs.basecompute.co