Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
haLLawa4-7b – AI Model by AbacusResearch | AlphaNeural AI
You can deploy this model and start earning money today!
AbacusResearch
/
haLLawa4-7b
like
0
transformers
safetensors
mistral
text-generation
merge
mergekit
lazymergekit
mlabonne/Monarch-7B
paulml/OGNO-7B
AbacusResearch/haLLAwa3
apache-2.0
model-index
autotrain_compatible
text-generation-inference
endpoints_compatible
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
haLLawa4-7b
haLLawa4-7b is a merge of the following models using
mergekit
:
mlabonne/Monarch-7B
paulml/OGNO-7B
AbacusResearch/haLLAwa3
🧩 Configuration
```yaml models:
model: eren23/ogno-monarch-jaskier-merge-7b
No parameters necessary for base model
model: mlabonne/Monarch-7B #Emphasize the beginning of Vicuna format models parameters: weight: 0.5 density: 0.59
model: paulml/OGNO-7B parameters: weight: 0.2 density: 0.55
Vicuna format
model: AbacusResearch/haLLAwa3 parameters: weight: 0.3 density: 0.55
merge_method: dare_ties base_model: eren23/ogno-monarch-jaskier-merge-7b parameters: int8_mask: true dtype: bfloat16 random_seed: 0 ```
Open LLM Leaderboard Evaluation Results
Detailed results can be found
here
Metric
Value
Avg.
75.25
AI2 Reasoning Challenge (25-Shot)
71.50
HellaSwag (10-Shot)
88.36
MMLU (5-Shot)
64.49
TruthfulQA (0-shot)
74.27
Winogrande (5-shot)
82.40
GSM8k (5-shot)
70.51
