Views
No views yet
Full_TriVis
(split_lab_front.csv, front view, lab). Architecture is T2M-GPT (CVPR 2023) adapted to
128-keypoint DWPose skeletons, with vinai/phobert-base-v2 (frozen, mean-pooled) replacing
CLIP as the text encoder.| this v1 | the v2 run | |
|---|---|---|
| stage-2 iterations | stopped at 8,000 | 30,000 (best @ 24,000) |
| hands MPJPE (80-clip val) | 0.34756 | 0.22408 |
| len_ratio | 2.77 | 0.959 |
len_ratio 2.77: generated sequences run ~2.8× longer than the
reference. v1 was selected on greedy decoding, which almost never emits the end token, so
generation runs to the block limit. Switching selection to categorial sampling fixed the
length behaviour and is what produced v2. If you need a working model, use the v2 run.| file | what |
|---|---|
net_best.pth | stage-2 GPT, best-by-greedy-metric checkpoint (222 MB) |
net_last.pth | stage-2 GPT, final checkpoint |
vq_net_best.pth | stage-1 VQ-VAE (vq_vsl_front_lab), required to decode tokens |
run.log | full training log incl. the per-eval len_ratio trace |
w_body=1.0 w_face=0.5 w_hand=3.0, l1_smooth recon, masked by keypoint
validity, EMA+code-reset quantizer, nb_code=512, down_t=2. Stage-1 val hands MPJPE 0.02716.