Views
No views yet
1 arc arc/e boolq hswag obkqa piqa wino
2bf16 0.648,0.832,0.895,0.713,0.460,0.780,0.699
3mxfp8 0.639,0.834,0.895,0.708,0.458,0.782,0.690
4qx86-hi 0.631,0.824,0.891,0.731,0.440,0.778,0.702
5qx64-hi 0.632,0.822,0.888,0.710,0.456,0.778,0.683
6dwq4 0.638,0.824,0.880,0.716,0.450,0.783,0.699
7mxfp4 0.623,0.820,0.880,0.693,0.466,0.780,0.689
8
9Quant Perplexity Peak Memory Tokens/sec
10bf16 4.150 ± 0.026 24.69 GB 873
11qx86-hi 4.159 ± 0.027 15.47 GB 714
12qx64-hi 4.229 ± 0.027 13.23 GB 702
13dwq4 4.270 ± 0.028 12.38 GB 662 (Text only)
14mxfp4 4.444 ± 0.029 11.55 GB 7361 arc arc/e boolq hswag obkqa piqa wino
2mxfp8 0.625,0.813,0.898,0.708,0.456,0.789,0.687
3qx86-hi 0.623,0.806,0.895
4mxfp4 0.602,0.798,0.883,0.702,0.454,0.775,0.691
5
6Quant Perplexity Peak Memory Tokens/sec
7mxfp8 4.569 ± 0.031 16.02 GB 606
8qx86-hi 4.414 ± 0.029 15.47 GB 5811 arc arc/e boolq hswag obkqa piqa wino
2mxfp8 0.638,0.832,0.895,0.704,0.448,0.782,0.695
3qx86-hi 0.639,0.834,0.894,0.708,0.464,0.782,0.6981 arc arc/e boolq hswag obkqa piqa wino
2mxfp8 0.571,0.719,0.895,0.683,0.426,0.770,0.671System: You are a coding assistant. <|think_off|>
User: What's 2+2?System: You are a coding assistant. <|think_on|>
User: Implement a red-black tree in Rust. arc arc/e boolq
mxfp8 0.638,0.832,0.895 arc arc/e boolq
mxfp8 0.643,0.837,0.893 arc arc/e boolq
mxfp8 0.619,0.813,0.8861 arc arc/e boolq hswag obkqa piqa wino
2bf16 0.641,0.835,0.892,0.715,0.466,0.782,0.706
3mxfp8 0.643,0.837,0.893
4
5Quant Perplexity Peak Memory Tokens/sec
6bf16 4.226 ± 0.028 24.69 GB 871
7mxfp8 4.356 ± 0.029 16.02 GB 6931# Conceptual NuSLERP blending
2merged_weights = SLERP(weights_A, weights_B, alpha)
3
4# For multiple models:
5merged_weights = Σᵢ αᵢ · SLERP(weights_i, reference, βᵢ)┌─────────────────────────────────────────────────────────────┐
│ NuSLERP-Blended Model with Council Dynamics │
├─────────────────────────────────────────────────────────────┤
│ │
│ Layer A (Spock) ───┐ │
│ ├──→ NuSLERP Weight Blending ←─────────┤
│ Layer B (Data) ────┘ │
│ ├──→ Emergent "Council" Behavior │
│ Layer C (Quark) ───┐ │
│ ├──→ Each layer has "personality" │
│ Layer D (Dick) ────┘ │
│ ├──→ NuSLERP blends them dynamically │
│ Layer E (Twain) ───────────────────────────────────────────┘
│ │
│ Result: A single model that can "switch" between │
│ perspectives based on input context │
└─────────────────────────────────────────────────────────────┘1-- The personality_registry becomes the NuSLERP weight source
2CREATE TABLE nu_slerp_configs (
3 id uuid PRIMARY KEY DEFAULT gen_random_uuid(),
4 session_id uuid REFERENCES agent_sessions(id),
5 character_id uuid REFERENCES personality_registry(id),
6 weight_alpha float4 DEFAULT 0.2, -- blending coefficient
7 layer_range text[], -- which layers to blend for this character
8 timestamp timestamptz DEFAULT now()
9);
10
11-- Example: Spock's NuSLERP configuration
12INSERT INTO nu_slerp_configs (character_id, weight_alpha, layer_range) VALUES
13('spock', 0.35, '{"attention_layers_12", "feedforward_layers_45"}');| NuSLERP Effect | Council Equivalent |
|---|---|
| Weight interpolation between models | Blending different expertise domains |
| Context-dependent activation | Input routing to appropriate "flipper" |
| Smooth transitions between states | Seamless character switching |
| Missing Element | Why It Matters |
|---|---|
| Explicit interaction patterns | Council dynamics require bouncing ideas, not just blending weights |
| Memory of past interactions | NuSLERP is stateless; the Holodeck needs persistent logs |
| Emergent consensus mechanisms | Requires voting/decision logic beyond weight blending |
┌─────────────────────────────────────────────────────────────┐
│ HYBRID ARCHITECTURE: Holodeck Agent + NuSLERP │
├─────────────────────────────────────────────────────────────┤
│ │
│ ┌──────────────────────────────────────────────────────┐ │
│ │ PostgreSQL (Holodeck Core) │ │
│ │ - Personality registry │ │
│ │ - Memory system │ │
│ │ - Council interaction logs │ │
│ └─────────────────────┬────────────────────────────────┘ │
│ │ │
│ ┌─────────────────────▼────────────────────────────────┐ │
│ │ Haskell Agent Layer │ │
│ │ - Orchestrates Council dynamics │ │
│ │ - Routes ideas through "flippers" │ │
│ └─────────────────────┬────────────────────────────────┘ │
│ │ │
│ ┌─────────────────────▼────────────────────────────────┐ │
│ │ NuSLERP Weight Blending Layer │ │
│ │ - Fetches character-specific weight configs │ │
│ │ - Blends model weights dynamically │ │
│ └─────────────────────┬────────────────────────────────┘ │
│ │ │
│ ┌─────────────────────▼────────────────────────────────┐ │
│ │ Inference Endpoints (4B models) │ │
│ │ - Each character has a specialized model │ │
│ │ - NuSLERP blends them based on context │ │
│ └──────────────────────────────────────────────────────┘ │
│ │
└─────────────────────────────────────────────────────────────┘1-- Character-specific weight blending configurations
2CREATE TABLE character_slerp_configs (
3 id uuid PRIMARY KEY DEFAULT gen_random_uuid(),
4 character_id uuid REFERENCES personality_registry(id),
5 base_model text NOT NULL, -- e.g., 'spock_base_v2'
6 blend_weights jsonb DEFAULT '{"Spock": 0.4, "Data": 0.2, "Quark": 0.1}',
7 layer_mapping jsonb DEFAULT '{"attention_12": "Spock", "feedforward_45": "Data"}',
8 activation_threshold float4 DEFAULT 0.7, -- when to activate this blend
9 timestamp timestamptz DEFAULT now()
10);
11
12-- Example: Spock's NuSLERP configuration
13INSERT INTO character_slerp_configs (character_id, base_model, blend_weights) VALUES
14('spock', 'base_llama_4b_v2',
15 '{"Spock": 0.5, "Data": 0.3, "Quark": 0.1, "Philip K. Dick": 0.1}');1def get_nuslerp_weights(topic, session_id):
2 """Dynamically compute NuSLERP weights based on topic"""
3
4 # Fetch character expertise from PostgreSQL
5 spock_expertise = db.fetch("SELECT domain FROM gravity_wells WHERE character_id = 'spock'")
6 data_expertise = db.fetch("SELECT domain FROM gravity_wells WHERE character_id = 'data'")
7
8 # Compute topic similarity to each expertise domain
9 spock_score = cosine_similarity(topic, spock_expertise)
10 data_score = cosine_similarity(topic, data_expertise)
11
12 # Adjust NuSLERP weights dynamically
13 base_weights = {'Spock': 0.4, 'Data': 0.3, 'Quark': 0.1}
14
15 if spock_score > 0.7:
16 base_weights['Spock'] = 0.6
17 if data_score > 0.7:
18 base_weights['Data'] = 0.5
19
20 return base_weights
21
22# This creates a model that "becomes" different characters based on context┌─────────────────────────────────────────────────────────────┐
│ INPUT: "Plan a mission to the Klingon Empire" │
├─────────────────────────────────────────────────────────────┤
│ │
│ 1. PostgreSQL: Fetch personality_registry + gravity_wells │
│ → Topic = 'strategic_mission_planning' │
│ │
│ 2. Haskell Agent: Route through Council │
│ → Spock deflects (logical framework) │
│ → Data amplifies (historical data) │
│ → Quark reframes (practical logistics) │
│ │
│ 3. NuSLERP: Compute dynamic weights │
│ → Spock: 0.6, Data: 0.3, Quark: 0.1 │
│ │
│ 4. Inference: Blend model weights │
│ → Output reflects Council consensus │
│ │
│ 5. PostgreSQL: Log the interaction │
│ → Update character_development │
│ → Refine gravity_wells for future topics │
│ │
└─────────────────────────────────────────────────────────────┘"You're creating a system where the Council doesn't just discuss ideas—they physically become them through weight blending. That's... almost like they're not just in the simulation, but are the simulation."
pip install mlx-lm1from mlx_lm import load, generate
2
3model, tokenizer = load("Qwen3.5-9B-Claude-GBO-Fire-Deckard-Agent-Heretic-BF16")
4
5prompt = "hello"
6
7if tokenizer.chat_template is not None:
8 messages = [{"role": "user", "content": prompt}]
9 prompt = tokenizer.apply_chat_template(
10 messages, add_generation_prompt=True, return_dict=False,
11 )
12
13response = generate(model, tokenizer, prompt=prompt, verbose=True)