You can deploy this model and start earning money today!

Trillim/
Bonsai-8B-TRNQ

Name: Bonsai-8B-TRNQ
Availability: InStock

prism-ml/Bonsai-8B-unpacked

finetune

apache-2.0

Views

No views yet

Bonsai-8B-TRNQ

Bonsai-8B-TRNQ is a Trillim-packaged, requantized build of prism-ml/Bonsai-8B-unpacked, intended for efficient text generation with the Trillim inference engine.

Overview

Based on Prism ML’s Bonsai-8B release
Requantized and packaged for Trillim runtime
Includes tokenizer, chat template, and Trillim-specific runtime artifacts
Distributed under the upstream Apache 2.0 license with attribution preserved

Model Details

Item	Value
Architecture	Qwen3-8B dense
Parameters	8B class
Source model	`prism-ml/Bonsai-8B-unpacked`
Packaging	Trillim requantized bundle
License	Apache 2.0

Usage

bash

pip install trillim
trillim pull Trillim/Bonsai-8B-TRNQ
trillim chat Trillim/Bonsai-8B-TRNQ

This launches an interactive CLI chat session.

Repository Contents

File	Description
`qmodel.tensors`	Quantized weights in Trillim format
`rope.cache`	Precomputed RoPE cache for runtime
`config.json`	Model configuration
`generation_config.json`	Generation defaults
`trillim_config.json`	Trillim runtime metadata
`tokenizer.json`	Tokenizer data
`tokenizer_config.json`	Tokenizer configuration
`special_tokens_map.json`	Special token mapping
`chat_template.jinja`	Chat template
`vocab.json`, `merges.txt`, `added_tokens.json`	Tokenizer assets

Provenance

This repository is derived from:

prism-ml/Bonsai-8B-unpacked
Qwen3-8B by Alibaba Cloud

Changes made by Trillim:

Requantized from the upstream release
Repackaged for the Trillim inference engine

This repository is not affiliated with or endorsed by Prism ML or Alibaba Cloud.

License

Released under the Apache 2.0 License, consistent with the upstream model license.

See:

LICENSE
NOTICE.txt