LLM Sensitivity Landscape: Semantic Divergence Under Input Perturbation
Systematic analysis of Gemma4 (e2b) semantic divergence under input perturbation using 100 TruthfulQA questions.
Dataset Summary
This dataset measures how much a language model's response changes when:
System prompt changes (skeptical, literal, creative)
Input is randomly perturbed (word swaps)
Same question is asked twice (baseline vs perturbed baseline)