Views
No views yet
observation.state: [16] (selected joint positions)observation.images.head: [3, 360, 640] (RGB)observation.images.wrist_left: [3, 480, 640] (RGB)observation.images.wrist_right: [3, 480, 640] (RGB)action: [16] (joint commands)| Parameter | Value |
|---|---|
| Chunk Size | 50 |
| Action Steps | 50 |
| Optimizer | AdamW |
| Learning Rate | 1e-05 |
| Backbone LR | 1e-05 |
| Weight Decay | 0.0001 |
| Batch Size | 32 |
| KL Weight | 10.0 |
| Dropout | 0.1 |
| Encoder Layers | 4 |
| Decoder Layers | 1 |
| Model Dim | 512 |
| Attention Heads | 8 |
| Latent Dim (VAE) | 32 |
| Normalization | MEAN_STD |
1python scripts/launch_sync.py \
2 --model_path <MODEL_PATH> \
3 --dataset_path <DATASET_PATH> \
4 --camera_source zmq \
5 --zmq_camera_host <NX_IP> \
6 --device mps \
7 --robot_ip <NUC_IP> \
8 --fps 10 \
9 --task 'pick the bottle and place into the box' \
10 --temporal_ensemble_coeff 0.011# Start Inference Server (on GPU Workstation or Jetson)
2python scripts/launch_async_server.py \
3 --host 0.0.0.0 \
4 --port 8000 \
5 --fps 10
6
7# Start Robot Client (on Jetson connected to Robot NUC)
8python scripts/launch_async_client.py \
9 --model_path <MODEL_PATH> \
10 --dataset_path <DATASET_PATH> \
11 --robot_ip <NUC_IP> \
12 --server_address <SERVER_IP>:8000 \
13 --device mps \
14 --policy_type act \
15 --fps 10