CROSS-MODEL FUSION: SmolLM2-135M body with a Qwen2.5-0.5B FFN layer at position 12. Different model architectures, different training — only +7.2 PPL degradation. This is the definitive proof that CECI grafting works across model families. The GRC basis projection successfully aligns a completely foreign FFN into the host model's geometric framework.
Perplexity testing confirms the graft transfers functional structure without destroying the model.
1from transformers import AutoModelForCausalLM, AutoTokenizer
2
3model = AutoModelForCausalLM.from_pretrained("NagusameCS/minFjollede", trust_remote_code=True)
4tokenizer = AutoTokenizer.from_pretrained("NagusameCS/minFjollede")