This dataset shares additional details of the settings and methodology used in evaluating nova-act-v1.0, a custom Nova 2 Lite model that powers the Amazon Nova Act AWS service. All scores are reported mean@5 unless indicated otherwise. Nova Act is evaluated in a pure vision setting (i.e., no DOM or accessibility trees are provided).
Responses from Nova Act in this dataset are released under a CC-BY-NC license. The public benchmarks… See the full description on the dataset page:
https://huggingface.co/datasets/amazon-agi/Amazon-Nova-Act-v1.0-evals.
