Views
No views yet
draft_paper_falsification.md (IGBundle-LLM repository), including the
curvature-telemetry weight-invariance result (§2.6).adapter_weights.pt, pickle format, 58,705,739
bytes) for the GeometricIGBundleAdapter — a nonlinear residual adapter
module injected into transformer blocks of a frozen Qwen2.5-7B. It is not a
PEFT/LoRA adapter and cannot be loaded with PeftModel.from_pretrained.| Field | Value |
|---|---|
SHA256 (adapter_weights.pt) | 2004373636B049FC03771EE087FF1E4053D8003C18C8F3FA94668D598145DB14 |
| Training script | train_refined_hf.py (IGBundle-LLM repo) |
| Training step | 3000 (of a 5000-step Phase 8 run) |
| Base model | Qwen2.5-7B (local cp600 merge lineage), 4-bit NF4 during training |
| Code commit required to instantiate | 579dd7c (branch dev-multimodal-physics, includes the 2026-07 audit fixes; any commit ≥ 7522e99 instantiates the architecture) — the public GitHub snapshot from January 2026 cannot instantiate this checkpoint (missing dynamics/, geometry/poincare.py, geodesic attention) |
1from igbundle.core.config import IGBundleConfig
2
3config = IGBundleConfig(
4 hidden_size=3584, # Qwen2.5-7B
5 latent_dim=64,
6 num_components=8,
7 num_categories=16,
8 use_dynamics=True,
9 use_geodesic_attn=True,
10 supported_modalities=["vision", "text"],
11)1import sys, torch
2sys.path.insert(0, "IGBundle-LLM/src") # commit 7522e99+
3
4from transformers import AutoModelForCausalLM
5from igbundle.core.config import IGBundleConfig
6from igbundle.modules.geometric_adapter import create_geometric_adapter
7from igbundle.integrations.hf_patch import wrap_hf_candidate
8
9model = AutoModelForCausalLM.from_pretrained("Qwen/Qwen2.5-7B", torch_dtype="bfloat16")
10config = IGBundleConfig(hidden_size=3584, latent_dim=64, num_components=8,
11 num_categories=16, use_dynamics=True, use_geodesic_attn=True)
12model = wrap_hf_candidate(model, config) # injects adapters into every block
13state = torch.load("adapter_weights.pt", map_location="cpu", weights_only=True)
14# state keys are namespaced per wrapped layer; align with your wrapping depth.| Claim | Status |
|---|---|
| Fixed Poincaré kernels (Möbius add, exp/log maps, distance) mathematically correct | EMPIRICAL — Ganea formulas verified; 100% kernel-faithfulness tests |
Learned metric (metric_chol) converged to identity (flat) | EMPIRICAL — eigenspectrum ≈ 1; verify with scripts/kappa_invariance_test.py |
| Published curvature telemetry (K = −5.63/−5.72) reflects learned hyperbolicity | FALSIFIED — the estimator is weight-invariant with the hardcoded conformal factor; those values are an architecture constant read at the projection boundary (paper §2.6) |
| Downstream task improvement over base Qwen2.5-7B | NONE MEASURED — ARC-Challenge 54.86%, identical to base; ARC eval accuracy 0.01 (n=100) |
potential_net (Hamiltonian dynamics) received training signal | NO — gradient path severed by no_grad/detach in the training-era code (fixed post-hoc behind config.differentiable_dynamics) |
1python scripts/kappa_invariance_test.py --checkpoint path/to/adapter_weights.pt
2# Verified output (2026-07-05, CPU, float64):
3# trained (cp3000) = identity = analytic closed form = -32.660
4# trained vs identity relative deviation: 1.22e-12 -> WEIGHT-INVARIANT
5# ||trained_chol - I|| / ||I|| = 0.079 -> metric converged to flat
6# radius sweep: kappa -130.8 (r=0.1) ... -4.4 (r=0.9) -> published values sit on
7# the fixed curve near the r=0.95 projection boundarydraft_paper_falsification.md §2.5–§2.7 for the full
reconciliation and the measured values.