Beta
Explore
Marketplace
Neural Labs
Playground
Wallet
Docs
mistral-nemo-gutenberg-12B-v3 – AI Model by nbeerbower | AlphaNeural AI
You can deploy this model and start earning money today!
nbeerbower
/
mistral-nemo-gutenberg-12B-v3
like
0
transformers
safetensors
mistral
text-generation
conversational
jondurbin/gutenberg-dpo-v0.1
intervitens/mini-magnum-12b-v1.1
finetune
apache-2.0
model-index
autotrain_compatible
text-generation-inference
endpoints_compatible
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
mistral-nemo-gutenberg-12B-v3
intervitens/mini-magnum-12b-v1.1
finetuned on
jondurbin/gutenberg-dpo-v0.1
.
Method
Finetuned using an A100 on Google Colab for 3 epochs.
Fine-tune Llama 3 with ORPO
Open LLM Leaderboard Evaluation Results
Detailed results can be found
here
Metric
Value
Avg.
19.06
IFEval (0-Shot)
21.83
BBH (3-Shot)
34.96
MATH Lvl 5 (4-Shot)
4.61
GPQA (0-shot)
8.61
MuSR (0-shot)
15.00
MMLU-PRO (5-shot)
29.38
