Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
Qwen2.5-14B-Instruct-1M-HF-GK – AI Model by pk11 | AlphaNeural AI
You can deploy this model and start earning money today!
pk11
/
Qwen2.5-14B-Instruct-1M-HF-GK
like
0
safetensors
qwen2
2412.04318
2501.04697
Qwen/Qwen2.5-14B-Instruct-1M
finetune
apache-2.0
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
Fine-tuned/hyperfitted with methodology from
https://arxiv.org/abs/2412.04318
using OrthoGrad optimizer
https://arxiv.org/abs/2501.04697
Updated 23.02.2025: same dataset, 512 token sequences with 64 tokens sliding window (loss still decreased). Significant hellaswag drop (~22%)
