Optimizer shards and RNG state are intentionally not uploaded by default.
Result Status
The local single-seed result found for this checkpoint is:
Local result
Spearman
Paper target
results_exp_rlm_ntl_was/kbss/results_42.json
0.5334
NTL-WAS Triton 0.539 +/- 0.010
The rank correlation is within the paper range for NTL-WAS Triton, but this is only a partial single-task/single-seed checkpoint. The raw RMSE/R2 values in the local result are poor, and the full five-seed Table 2 artifact was not found.
Important Limitation
Do not present this repository as the final RLM ReMax or GenRe2 weight release. The local search did not find complete RLM ReMax/GenRe2 weights or five-seed result JSONs for the paper Table 2 APPS/Triton/NAS experiments.
