Views
No views yet
I like the Phi-2 variants, and noticed there isn't a single repo that offers GGUF with a full range of sizes. I quantized this model for myself, but also for anyone else interested. It includes a good variety of small quants + Q6_K, Q8_0, F16 + Imatrix.
<|im_start|>system
You are a helpful assistant for Python which outputs in Markdown format.<|im_end|>
<|im_start|>user
Write a function to calculate the Fibonacci sequence<|im_end|>
<|im_start|>assistant
<|im_start|>system
You are a helpful assistant. Be short and direct in your answers.<|im_end|>
<|im_start|>user
Was Tom Hanks in the movie Forrest Gump? If so, who did he play and give details of the plot.<|im_end|>
<|im_start|>assistant| Metric | Value |
|---|---|
| Average | 63.67 |
| AI2 Reasoning Challenge (25-Shot) | 61.86 |
| HellaSwag (10-Shot) | 76.32 |
| MMLU (5-Shot) | 55.72 |
| TruthfulQA (0-shot) | 54.84 |
| Winogrande (5-shot) | 75.69 |
| GSM8k (5-shot) | 57.62 |
| Metric | Value |
|---|---|
| Average | 49.64 |
| AGIEval | 34.55 |
| GPT4All | 70.96 |
| TruthfulQA | 54.87 |
| Bigbench | 38.17 |