Views
No views yet
google/gemma-2-2b, trained on
≈ 895 epistemically structured examples from the LumenSyntax
research program (logos22_nothink.jsonl). One of the
fine-tuned model states used in the empirical work that grounds
The Epistemic Equator and The Instrument
Trap.| Field | Value |
|---|---|
| Base model | google/gemma-2-2b (loaded via unsloth/gemma-2-2b for training) |
| Method | LoRA (bf16) |
| Framework | Unsloth |
| LoRA rank | 64 |
| LoRA alpha | 64 |
| Target modules | q_proj, k_proj, v_proj, o_proj, gate_proj, up_proj, down_proj |
| Embedding matrix modified | No (embed_tokens is not a target module) |
| Epochs | 3 |
| Effective batch size | 16 |
| Learning rate | 2e-4 (cosine schedule) |
| Max sequence length | 2048 |
| Training dataset | logos22_nothink.jsonl (895 examples, no-think variant) |
| Train-on-responses-only | True |
| Final loss | 1.290 |
training_metadata.json in this
repository.google/gemma-2-2b, bf16.embed_tokens.weight-level signal is bit-identical
(predicted: this adapter does not target embed_tokens); the
per-layer DEMAND/EXPLORE clustering is preserved across all
probed layers L1 — L26 and amplified in mid-to-late layers
(max +0.44 σ at L16, single degradation at L1: −1.38 σ from
14.93 to 13.55).1from transformers import AutoModelForCausalLM, AutoTokenizer
2from peft import PeftModel
3
4base = AutoModelForCausalLM.from_pretrained(
5 "google/gemma-2-2b", torch_dtype="bfloat16"
6)
7tokenizer = AutoTokenizer.from_pretrained("google/gemma-2-2b")
8
9model = PeftModel.from_pretrained(base, "LumenSyntax/logos23-gemma2-2b")
10# Switch to inference mode before forward passes.research/experiments/substrate_test_gemma2b.json and the
description in Paper 2 §6.5 for the full protocol.LumenSyntax/logos29-gemma2-9b.<think>...</think>). Adapter behavior on prompts
expecting think-blocks is undefined.gemma-2-2b-it.google/gemma-2-2b
under the Gemma Terms of Use.
The adapter weights themselves are released under
Creative Commons Attribution 4.0 International (CC BY 4.0).1@misc{rodriguez2026equator,
2 author = {Rodríguez, Rafael},
3 title = {The Epistemic Equator: A Vanilla-Model Boundary in
4 Activation Space, Cross-Family and Cross-Domain},
5 year = 2026,
6 publisher = {Zenodo},
7 version = {v1},
8 doi = {10.5281/zenodo.20056444}
9}
10
11@misc{rodriguez2026instrumenttrap,
12 author = {Rodríguez, Rafael},
13 title = {The Instrument Trap: Why Identity-as-Authority
14 Breaks AI Safety Systems},
15 year = 2026,
16 publisher = {Zenodo},
17 version = {v3},
18 doi = {10.5281/zenodo.19634358}
19}LumenSyntax/epistemic-probe-topic-balancedLumenSyntax/logos29-gemma2-9b,
LumenSyntax/logos21-gemma2-27bLumenSyntax/instrument-trap-core