Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
Lyra4-Gutenberg2-12B – AI Model by nbeerbower | AlphaNeural AI
You can deploy this model and start earning money today!
nbeerbower
/
Lyra4-Gutenberg2-12B
like
0
transformers
safetensors
mistral
text-generation
conversational
jondurbin/gutenberg-dpo-v0.1
nbeerbower/gutenberg2-dpo
Sao10K/MN-12B-Lyra-v4
finetune
cc-by-nc-4.0
model-index
autotrain_compatible
text-generation-inference
endpoints_compatible
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
image/png
Lyra4-Gutenberg2-12B
Sao10K/MN-12B-Lyra-v4
finetuned on
jondurbin/gutenberg-dpo-v0.1
and
nbeerbower/gutenberg2-dpo
.
Features an increased sequence length from Lyra4-Gutenberg-12B.
Method
ORPO Finetuned
using 2x RTX 3090 for 3 epochs.
Training data was formatted with ChatML.
Open LLM Leaderboard Evaluation Results
Detailed results can be found
here
Metric
Value
Avg.
19.74
IFEval (0-Shot)
25.85
BBH (3-Shot)
33.73
MATH Lvl 5 (4-Shot)
10.50
GPQA (0-shot)
8.39
MuSR (0-shot)
11.49
MMLU-PRO (5-shot)
28.51
