Views
No views yet
nvidia/GR00T-N1.7-3B,
trained on a single SO-ARM101 manipulation task (90 episodes,
"Place the white eraser on the red square"). Produced with the
gr00t-n17-lora wrapper.Status: demo / verification only. This adapter exists to demonstrate that the wrapper successfully restores LoRA support on GR00T N1.7. It is trained on a deliberately small, single-task dataset and is not a production-quality skill. See "Limitations" below.
| Field | Value |
|---|---|
| Base model | nvidia/GR00T-N1.7-3B |
| LoRA rank | 32 |
| LoRA alpha | 64 |
| LoRA dropout | 0.05 |
| Target modules | attention (q_proj, k_proj, v_proj, o_proj, to_q, to_k, to_v, to_out.0) and MLPs (gate_proj, up_proj, down_proj, net.2, 0.proj) |
modules_to_save | state_encoder, action_encoder, action_decoder, position_embedding, vlln, vl_self_attention |
| Adapter size on disk | ~2.2 GB |
Note onadapter_config.json. Thetask_typefield is intentionally absent. PEFT serialisestask_type=Noneby omitting the key, and the Hub's metadata validator displays a "Configuration Parsing Warning" because its schema expects a known string here. This is cosmetic:PeftModel.from_pretrainedloads a genericPeftModelwhentask_typeis unset, which is the correct path for GR00T'sdict-inputforward. Setting it to an NLP enum value such asFEATURE_EXTRACTIONwould force aninput_ids/attention_maskkeyword signature on the base model and break inference. See the wrapper'sdocs/debugging_journey.md§ Blocker 2 for context.
1git clone https://github.com/jinnymo/gr00t-n17-lora
2cd gr00t-n17-lora
3pip install -r requirements.txt
4
5huggingface-cli download nvidia/GR00T-N1.7-3B --local-dir models/GR00T-N1.7-3B
6huggingface-cli download dongyoonkim/grootn17-lora-so101-eraser-tier1 \
7 --local-dir adapter
8
9python verify_inference.py --base models/GR00T-N1.7-3B --adapter adapterdongyoonkim/so101-eraser-90ep-wrist.| Hyperparameter | Value |
|---|---|
| Optimizer | paged_adamw_8bit (bitsandbytes) |
| Learning rate | 1e-4 |
| LR schedule | cosine, warmup ratio 0.05 |
| Batch size (global) | 16 |
| Steps | 15,000 |
| Gradient checkpointing | enabled |
| Hardware | single RTX 3090 Ti (24 GB) |
| Wall time | ~2.3 h |
| Final training loss | 0.029 (best 0.0181 near step 14940) |
| Checkpoint step | Avg MAE (deg) | Avg MSE |
|---|---|---|
| 3000 | 3.846 | 36.51 |
| 6000 | 2.803 | 25.57 |
| 9000 | 2.347 | 20.15 |
| 12000 | 1.860 | 12.73 |
| 15000 (this adapter) | 1.661 | 10.85 |
modules_to_save, no MLP targets)
reaches 6.13 deg MAE.