A quantized stateful KV-cache chat .aimodel — an Apple Core AI conversion of WeiboAI/VibeThinker-3B, with an embedded tokenizer + chat template. Produced by coreai-fabric and indexed by coreai-catalog.

Model facts

Field	Value
Parameters	3B
Architecture	transformer
Capabilities	text-generation, reasoning
Quantization / precision	none / float16
Context length	32768
On-disk size	5.7 GB
Asset kind	stateful KV-cache chat bundle; embedded tokenizer + chat template
assetVersion	2.0

Use it

Install via the catalog, then run it with Apple's Foundation Models runtime:

pip install coreai-catalog && coreai-catalog install vibethinker-3b

swift

import CoreAILanguageModels
import FoundationModels

// modelURL = the installed macos/ bundle directory for this model
let model = try await CoreAILanguageModel(resourcesAt: modelURL)
let session = LanguageModelSession(model: model)
let reply = try await session.respond(to: "Explain on-device AI in one sentence.")
print(reply)

A complete, buildable example lives at coreai-catalog/examples/llm-chat.

Requirements

Deployment: macOS 27.0+ / iOS 27.0+, Xcode 27+. The asset serializes with minimum_os v27, so the on-device Swift runtime requires macOS/iOS 27+.
A Mac on macOS 26 can convert and inspect the asset but cannot run it on-device (the Swift runtime needs the 27 SDK).
Apple Silicon.

Intended use & limitations

Intended use: general on-device chat / text generation. Inherits the base model's capabilities, languages, and biases.
Limitations: uncompressed (fp16) — full precision. See the Evaluation section for the measured greedy fidelity vs the fp16 reference.

Evaluation (parity)

Gate A (structure): passed — the bundle's layout + metadata were validated on real hardware (Apple Silicon); the asset loads and generates.
Gate B (numeric accuracy): not_run. Task-accuracy evaluation (e.g. tinyMMLU) is pending upstream: Apple's coreai.llm.eval is a stub in coreai-models 0.1.0 that cannot score a stateful KV-cache asset. Greedy fidelity vs fp32 can be measured on-device via the parity runner. fabric never fakes a parity number.
Runtime throughput (tok/s): to be published once measured on the on-device (macOS/iOS 27) Swift runtime via coreai-fabric bench. Not estimated — real numbers or none.

Provenance

Field	Value
Base model	WeiboAI/VibeThinker-3B @ `77bd2cced09193c8b9a59a32bd8577bbd1f3e01c`
Converted by	`coreai.llm.export` (version not reported)
Recipe	vibethinker-3b (recipe_source: fabric)
Precision / quantization	float16 / none
Conversion date	2026-07-11

Machine-readable, in this repo: parity-report.json (gate results) · reproduce-manifest.json (exact tool + stack + pinned revision to reproduce this conversion) · LICENSE (upstream terms).

License and attribution

Weights licensed mit — see the bundled LICENSE. This artifact is a converted + quantized derivative of the base model (the Apache-2.0 §4(b) change notice): weights were converted to Apple Core AI format and quantized to uncompressed (fp16). The conversion itself is community work.

The on-device Core AI ecosystem

This conversion is part of a broader open ecosystem for running models on Apple's on-device stack — useful references if you're building here:

coreai-fabric — the reproducible recipe → .aimodel pipeline that produced this asset.
coreai-catalog — the index of Core AI models across the community, with provenance and integration snippets.
apple/coreai-models — Apple's official exporters and runtimes.
CoreAI Model Zoo and the wider coreai-community — community conversions across many model families.

Not affiliated with Apple

Community conversion. Not produced, hosted, or endorsed by Apple. Apple and Core AI are trademarks of Apple Inc., used here only to describe the target runtime/format. This is an independent community conversion.

kevinqz/VibeThinker-3B-CoreAI

VibeThinker 3B (fabric)