Views
No views yet
0xSero/NVIDIA-Nemotron-3-Super-120B-A12B-BF16-REAP-50pct-draft,
itself a 50%-expert-pruned (REAP) derivative of NVIDIA's
NVIDIA-Nemotron-3-Super-120B-A12B-BF16.| Property | Value |
|---|---|
| Base model | 0xSero/NVIDIA-Nemotron-3-Super-120B-A12B-BF16-REAP-50pct-draft |
| Upstream | nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 |
| Architecture | NemotronH (Mamba2 + Transformer hybrid MoE) |
| Active parameters / token | ~12B |
| Quantization | INT4 weight-only |
| Approx. on-disk size | ~39 GB |
| Languages | English |
1from vllm import LLM, SamplingParams
2
3llm = LLM(
4 model="drawais/Nemotron-3-Super-120B-A12B-REAP50-W4A16",
5 trust_remote_code=True,
6 max_model_len=65536,
7)
8params = SamplingParams(temperature=0.6, top_p=0.95, max_tokens=4096)
9print(llm.generate(["Hello, world!"], params)[0].outputs[0].text)1vllm serve drawais/Nemotron-3-Super-120B-A12B-REAP50-W4A16 \
2 --trust-remote-code \
3 --max-model-len 65536 \
4 --gpu-memory-utilization 0.94http://127.0.0.1:8000/v1.
For reasoning-mode controls, recommended --reasoning-parser,
tool-calling flags, and per-modality serving recommendations, follow
the upstream
Nemotron-3-Super model card.trust_remote_code=True is required.0xSero/NVIDIA-Nemotron-3-Super-120B-A12B-BF16-REAP-50pct-draft — BF16 source0xSero/NVIDIA-Nemotron-3-Super-120B-A12B-BF16-REAP-50pct-AutoRound-W4A16-draft — alternative INT4 (AutoRound)0xSero/NVIDIA-Nemotron-3-Super-120B-A12B-BF16-REAP-50pct-draft.
Source model © NVIDIA Corporation, released under the
NVIDIA Open Model Agreement.
This artifact is a Derivative Work as defined in that agreement.
See LICENSE and NOTICE for full text and
required attribution.LICENSE. The
attribution notice required by Section 3(c) is in NOTICE:Licensed by NVIDIA Corporation under the NVIDIA Open Model Agreement.