You can deploy this model and start earning money today!

Ashenzari/
vla-lstm-success-monitor

Name: vla-lstm-success-monitor
Availability: InStock

pytorch

vla-lstm-progress-monitor

Views

No views yet

VLA LSTM Progress Monitor — v2.1.0

This revision contains a five-fold LSTM ensemble trained to estimate causal robot-task progress from frozen VLA/VLM backbone features. It is the progress-only successor to the v1 success/failure monitor.

Version contract

Release: v2.1.0
Objective: progress-only
Training recipe: original progress loss + freeze/reverse temporal augmentation
Supported in-domain tasks: coffeecup, saucer, waterbottle, wine
Input: 10 Hz mean-pooled 4096-dimensional VLM features
Ensemble: mean progress from five collection-disjoint fold checkpoints
VLM feature source: new_vla_checkpoint_vlm_30k

Cached features from v2.0.0 are not compatible with these temporal heads. Re-extract features with the 30k-step VLA backbone before inference.

The model architecture still contains an outcome head for checkpoint compatibility, but that head was not trained for this release. Do not interpret its logits as success/failure probabilities. Only head_progress output is valid.

Loading a fold

Install the source repository and PyTorch when loading this LSTM release. The rank normalizer stored in each checkpoint must be applied before inference.

python

from huggingface_hub import snapshot_download
import json
import torch

from monitor.feature_normalization import TaskRankNormalizer
from monitor.model import Monitor

root = snapshot_download("Ashenzari/vla-lstm-success-monitor", revision="v2.1.0")
config = json.load(open(f"{root}/config.json"))
entry = config["checkpoints"][0]
checkpoint = torch.load(
    f"{root}/{entry['file']}", map_location="cpu", weights_only=True
)

model = Monitor(temporal="lstm", dropout=checkpoint["args"]["dropout"])
model.load_state_dict(checkpoint["model"], strict=True)
model.eval()
normalizer = TaskRankNormalizer.from_state_dict(checkpoint["rank_normalizer"])

# pooled_features: [T, 4096]
x = normalizer.transform(pooled_features.float(), task_id="wine")
with torch.inference_mode():
    _, progress = model(x.unsqueeze(0))
progress = progress[0]  # [T], range [0, 1]

For ensemble inference, repeat the same operation for all five checkpoint entries and average their progress curves.

Feature contract

Features were extracted from the new_vla_checkpoint_vlm_30k VLA checkpoint. Each prediction step uses the context offsets [-0.3, -0.2, -0.1, 0.0] seconds, 64 visual tokens, mean pooling, and a 4096-dimensional feature vector. Changing the VLA/VLM checkpoint can shift the feature distribution and requires revalidation.

Evaluation

See EVALUATION.md and config.json for the clean and freeze/reverse robustness metrics. The evaluation is in-domain and does not establish zero-shot performance on unseen tasks.