You can deploy this model and start earning money today!

geodesic-research/
nemotron-super-120b-cc-mt-uniform-dr-200k-sft

Name: nemotron-super-120b-cc-mt-uniform-dr-200k-sft
Availability: InStock

constitutional-curriculum

geodesic

geodesic-research/nemotron-super-120b-cc-mt-uniform-dr

finetune

other

Views

No views yet

nemotron-super-120b-cc-mt-uniform-dr-200k-sft

Nemotron 3 Super 120B-A12B non-reasoning (direct-answer chat) SFT from the constitutional-curriculum midtraining study — the SFT stage applied to the cc-mt-uniform-dr midtrained base.

Training

Base: geodesic-research/nemotron-super-120b-cc-mt-uniform-dr (re-imported to Megatron, fresh optimizer warm-start)
Data: geodesic-research/sft-warm-start-200k no_think
Recipe: 246 iterations, GBS 128, seq 8192, lr 5e-6 cosine w/ 10% warmup, tokenizer geodesic-research/nemotron-instruct-tokenizer, answer-only loss. Final lm loss ~0.60.
Topology: TP=1 EP=4 PP=22 ETP=1, 22 nodes / 88 GH200 GPUs on Isambard-AI.
Coherence: 8/8 clean at T=0.6 top_p=0.95, full 8192-token budget — W&B at5spzv9

Usage notes

Chat model — apply the bundled chat template. Recommended sampling: temperature 0.6, top_p 0.95 (Nemotron recommendation; higher temperatures occasionally emit a stray token right before EOS). Loads with native transformers NemotronHForCausalLM; tokenizer PreTrainedTokenizerFast.

geodesic-research/nemotron-super-120b-cc-mt-uniform-dr-200k-sft

nemotron-super-120b-cc-mt-uniform-dr-200k-sft

Training

Usage notes

geodesic-research/
nemotron-super-120b-cc-mt-uniform-dr-200k-sft