Views
No views yet
| Architecture | Laguna Mixture-of-Experts, text-to-text |
|---|---|
| Parameters | 118B total; approximately 8B active per token upstream |
| Layers | 48 |
| Experts | 256 routed + 1 shared, top-10 routing |
| Context | Configured up to 1,048,576 tokens; not long-context tested here |
| Quantization | oQ level 4 enhanced, MLX affine mixed precision |
| Weights | 63.017 GiB · 13 shards |
| State | Quantized target weights; optional draft distributed separately |
| File | Purpose | Required by | Notes |
|---|---|---|---|
model-00001-of-00013.safetensors … model-00013-of-00013.safetensors | Quantized target weights | MLX runtime | 13 shards · 63.017 GiB |
model.safetensors.index.json | Tensor-to-shard index | MLX loader · Hugging Face | Includes verified conceptual parameter metadata |
config.json | Architecture and quantization configuration | MLX · oMLX | Laguna custom code · affine mixed precision |
configuration_laguna.py · modeling_laguna.py | Custom Laguna implementation | Custom-code loaders | Carry Apache-2.0 notices |
tokenizer.json · tokenizer_config.json · special_tokens_map.json | Tokenizer data and settings | Prompt encoding and decoding | Inherited from the direct source |
chat_template.jinja | Chat, thinking, and tool-message formatting | Conversational inference | Native thinking remains enabled by default |
generation_config.json | Generation defaults and companion reference | oMLX runtime | DFlash remains external and optional |
oq_imatrix_report.json | Machine-readable calibration evidence | Quantization audit | Personal cache path redacted; limitations retained |
LICENSE · LICENSE-APACHE-2.0 | Redistribution terms | Recipients and redistributors | OpenMDW-1.1 materials · Apache-2.0-noticed code |
README.md · .gitattributes | Model card and Hub storage rules | Hugging Face Hub | English Lumen card · LFS tracking |
| Quantization | MLX affine mixed precision; 4-bit group-size-64 default with 5-, 6-, and 8-bit overrides |
|---|---|
| Effective storage | Approximately 4.605 bits per conceptual parameter, calculated from 67,664,427,590 weight bytes and 117,561,977,600 parameters |
| Stored dtypes | BF16 tensor values and U32 packed quantization data in Safetensors |
| Precision overrides | 386 configured tensor overrides: 105 at 5-bit, 1 at 6-bit, and 280 at 8-bit; 245 use group size 64 and 141 use group size 128 |
| Highest-precision tensors | lm_head and model.embed_tokens are configured at 8-bit, group size 64 |
| Calibration preset | oqe_code_multilingual |
| Collection | 1,024 processed samples · sequence length 512 |
| Expert coverage | 36,084 / 36,096 routes activated · 12 zero-count experts |
| Report status | coverage_sufficient: false · collection_sufficient: false |
| macOS | 26.5.2 · tested |
|---|---|
| Apple Silicon | MacBook Pro, M4 Max, 16-core CPU · tested |
| Unified memory | 128 GB · tested and recommended |
| Observed memory | Approximately 70 GB or less · maintainer observation, not instrumented |
| oMLX | 0.5.4 · tested |
mlx-lm | 0.31.3 · installed in test environment |
mlx-vlm | 0.6.3 · installed in test environment |
| MLX core | Exact version not recorded |
enable_thinking to true. Thinking was observed, but tool calling was not tested on this quantization.| Check | Result | Limit |
|---|---|---|
| Model load | Successful | One Mac configuration |
| Generation | Coherent landing page | Single qualitative prompt |
| Thinking | Observed | No structured evaluation |
| Tool calling | Not tested | Inherited configuration only |
| Long context | Not tested | Configured maximum unvalidated |
| DFlash | Runtime pairing completed | Speed and acceptance unmeasured |
LICENSE. Redistribution must retain the agreement and applicable copyright and origin notices.LICENSE-APACHE-2.0.