WhestBench Random ReLU MLPs — Monte-Carlo Activation Cumulants (10k)
A dataset of 10,500 random ReLU MLPs (10,000 train + 500 held-out test) together with
Monte-Carlo–estimated per-layer activation cumulants (mean, variance, skewness, kurtosis) for
every layer, for both the pre-activation and post-ReLU signals. Built for the WhestBench
Estimation Challenge 2026 and for research on analytic moment / uncertainty propagation
through deep networks.
The generative process… See the full description on the dataset page: https://huggingface.co/datasets/keenanpepper/whestbench-relu-mlp-moments-10k.