Views
No views yet
Please note that this is an experiment, and the model has limitations because it is smol.
Below is an instruction that describes a task, paired with an input that
provides further context. Write a response that appropriately completes
the request.
### Instruction:
How can I increase my meme production/output? Currently, I only create them in ancient babylonian which is time consuming.
### Inputs:
### Response:### Inputs:
1inference:
2 parameters:
3 do_sample: true
4 renormalize_logits: true
5 temperature: 0.25
6 top_p: 0.95
7 top_k: 50
8 min_new_tokens: 2
9 max_new_tokens: 96
10 repetition_penalty: 1.03
11 no_repeat_ngram_size: 5
12 epsilon_cutoff: 0.0008teknium/openhermes, which is generated/synthetic data by an OpenAI model. This means usage of this checkpoint should follow their terms of use: https://openai.com/policies/terms-of-use| Metric | Value |
|---|---|
| Avg. | 29.34 |
| AI2 Reasoning Challenge (25-Shot) | 25.17 |
| HellaSwag (10-Shot) | 28.98 |
| MMLU (5-Shot) | 26.17 |
| TruthfulQA (0-shot) | 43.08 |
| Winogrande (5-shot) | 52.01 |
| GSM8k (5-shot) | 0.61 |
| Metric | Value |
|---|---|
| Avg. | 4.76 |
| IFEval (0-Shot) | 15.55 |
| BBH (3-Shot) | 3.11 |
| MATH Lvl 5 (4-Shot) | 0.00 |
| GPQA (0-shot) | 2.35 |
| MuSR (0-shot) | 6.22 |
| MMLU-PRO (5-shot) | 1.34 |