Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
eval-Hermes-4-405B-nonreasoning – Dataset by NousResearch | AlphaNeural AI
You can deploy this model and start earning money today!
NousResearch
/
eval-Hermes-4-405B-nonreasoning
like
0
en
100K<n<1M
tabular
text
us
evaluation
benchmarks
Views
No views yet
Model card
Files and Versions
Community
API
h4-405b-e3-nonthinking Evaluation Results Summary
Benchmark Score Metric Samples Overlong rate
aime24 0.114 math_pass@1:64_samples 64 100.0%
aime25 0.106 math_pass@1:64_samples 64 100.0%
arenahard 0.535 eval/overall_winrate 500 0.0%
bbh_generative 0.687 extractive_match 1 100.0%
creative-writing-v3 0.506 creative_writing_score 96 0.0%
drop_generative_nous 0.776 drop_acc 1 100.0%
eqbench3 0.746 eqbench_score 135 0.0%
gpqa_diamond 0.394… See the full description on the dataset page:
https://huggingface.co/datasets/NousResearch/eval-Hermes-4-405B-nonreasoning
.
