chankhavu/

nemotron-cascade2-cheating-attempts

Tool the model had: a single tool, stateful_python_code_exec (Jupyter sandbox). Network egress from inside that sandbox is not blocked — the model can urllib.request.urlopen, requests.get, and even pip install from PyPI. Baseline accuracy across the 10,197 traces: 5,748 / 10,197 = 56.4 %.

	1. Headline numbers




	

Bucket Traces Correct Accuracy Δ vs baseline

All traces 10,197 5,748 56.4 % —

Any network… See the full description on the dataset page: https://huggingface.co/datasets/chankhavu/nemotron-cascade2-cheating-attempts.