Use the following dataset to fine-tune bigcode/starcoder2-7b in order to improve the model's reasoning and planning abilities.
Total 986k samples.
This model accepts the Alpaca instruction format.
You are an intelligent programming assistant.
### Instruction:
Implement a linked list in C++
### Response:
1{'ARC (acc_norm)': ,
2'HellaSwag (acc_norm)': ,
3'MMLU (acc)': ,
4'TruthfulQA (mc2)': ,
5'Winoground (acc)': ,
6'GSM8K (acc)': ,
7'DROP (f1)': ,
8'Open LLM Score': }
Detailed results can be found
here