From original readme
Delexa-V0.1-Instruct-7b: Our Newest and Best Model Yet!
We are excited to announce the release of Delexa-V0.1-Instruct-7b, our newest and best model yet! Delexa-V0.1-Instruct-7b has shown excellent performance on a variety of tasks, and we are confident that it will be a valuable asset to the research community.
Eval Results
Delexa-V0.1-Instruct-7b was evaluated on a dataset of question-answer pairs. The model was given a single question and three different answer choices, and it was tasked with selecting the best answer. Delexa-V0.1-Instruct-7b achieved an average score of 8.27 on this task.
Here is a table showing the detailed eval results:
| Model | Turn 1 | Turn 2 | Average |
|---|
| gpt-4 | 8.95625 | 9.0250 | 8.990625 |
| Delexa-V0.1-Instruct-7b | 8.57500 | 7.9500 | 8.268750 |
| claude-v1 | 8.15000 | 7.6500 | 7.900000 |
| gpt-3.5-turbo | 8.07500 | 7.8125 | 7.943750 |
| vicuna-13b-v1.3 | 6.81250 | 5.9625 | 6.387500 |
| palm-2-chat-bison-001 | 6.71250 | 6.0875 | 6.400000 |
