You can deploy this model and start earning money today!

creativityschapiro/
llama-3.1-8b-instruct-cn-dat-kr0.1-a1.0-creative

Name: llama-3.1-8b-instruct-cn-dat-kr0.1-a1.0-creative
Rating: 2.5 (10 reviews)

mechanistic-interpretability

2607.01433

meta-llama/Llama-3.1-8B-Instruct

finetune

apache-2.0

Views

No views yet

Llama-3.1-8B · CreativityNeuro

A CreativityNeuro (CN) variant of meta-llama/Llama-3.1-8B-Instruct, with the weight edit already applied. It loads and runs exactly like the base model.

CreativityNeuro amplifies the parameters that matter for divergent generation but not for convergent generation, improving divergent thinking with no fine-tuning, no prompt changes, and no decoding changes.

📄 Paper · 💻 Code · 🤗 All optimal configs

Configuration

Parameter	Value
Base model	meta-llama/Llama-3.1-8B-Instruct
ρ (keep ratio)	0.10
α (amplification)	1.0
Contrastive prompt set	`dat`
Mode	creative

This is the best-performing CreativityNeuro configuration for Llama-3.1-8B.

Usage

python

from transformers import AutoModelForCausalLM, AutoTokenizer

model = AutoModelForCausalLM.from_pretrained("creativityschapiro/llama-3.1-8b-instruct-cn-dat-kr0.1-a1.0-creative")
tokenizer = AutoTokenizer.from_pretrained("creativityschapiro/llama-3.1-8b-instruct-cn-dat-kr0.1-a1.0-creative")

outputs = model.generate(...)

Method

Parameter importance is scored Wanda-style, S_ij = Σ_b |W_ij| · ‖X_j‖₂, under two contrastive prompt sets. The top ρ of each is taken, and the set difference — important for divergent generation, not for convergent generation — is amplified:

W_new = W × (1 + α × mask)

To build masks yourself, or apply CN to a model not published here, see samjschapiro/creativityneuro.

Results

Across six instruction-tuned models, CreativityNeuro improves scores on the Divergent Association Task and transfers to open-ended creativity tasks judged by human raters (N = 720) — the Alternative Uses Test and the Task Task — with gains in originality (avg. Cohen's d = +0.36 AUT, +0.40 TT) and surprise (+0.43 AUT). Full results in the paper.

Citation

bibtex

@inproceedings{schapiro2026creativityneuro,
  title         = {CreativityNeuro: Steering Language Model Weights to Improve
                   Divergent Thinking and Reduce Mode Collapse},
  author        = {Schapiro, Samuel and Park, Core Francisco and Sosa, Felix
                   and Varshney, Lav R.},
  booktitle     = {Conference on Language Modeling (COLM)},
  year          = {2026},
  eprint        = {2607.01433},
  archivePrefix = {arXiv},
  primaryClass  = {cs.AI},
  url           = {https://arxiv.org/abs/2607.01433}
}