GGUF is a file format for representing AI models. It is the third version of the format, introduced by the llama.cpp team on August 21st 2023. It is a replacement for GGML, which is no longer supported by llama.cpp. Converted using llama.cpp build 1879 (revision 3e5ca79)

Prompt template: Zephyr

Zephyr-style appears to work well!

<|system|>
{{system_message}}</s>
<|user|>
{{prompt}}</s>
<|assistant|>

Download & run with cnvrs on iPhone, iPad, and Mac!

cnvrs is the best app for private, local AI on your device:

create & save Characters with custom system prompts & temperature settings
download and experiment with any GGUF model you can find on HuggingFace!
make it your own with custom Theme colors
powered by Metal ⚡️ & Llama.cpp, with haptics during response streaming!
try it out yourself today, on Testflight!
follow cnvrs on twitter to stay up to date

Original Model Evaluations:

Evaluations reported from mlabonne’s alternative leaderboard, YALL: Yet_Another_LLM_Leaderboard.

Model	AGIEval	GPT4All	TruthfulQA	Bigbench	Average
NeuralDaredevil-7B	45.23	76.2	67.61	48.52	59.39
Mistral-7B-Instruct-v0.2	38.5	71.64	66.82	42.29	54.81
openchat-3.5-0106	44.17	73.72	52.53	44.4	53.71
OpenHermes-2.5-Mistral-7B	42.75	72.99	52.99	40.94	52.42

brittlewis12/NeuralDaredevil-7B-GGUF

NeuralDaredevil-7B GGUF

What is GGUF?

Prompt template: Zephyr

Download & run with cnvrs on iPhone, iPad, and Mac!

Original Model Evaluations:

brittlewis12/
NeuralDaredevil-7B-GGUF