fireworks-ai/

function-calling-eval-dataset-v0

The hf dataset contains 2 evaluation datasets

single_turn - The converstaion length for this evaluation dataset is 2. It consists of a user ask followed by a function call by assistant. multi_turn - The conversation length is variable here but contains a combination of user messages, assistant function calls, assistant messages & tool responses.

Information about the columns

tools - List of functions/tools with specs in JSON format. This is the list of functions the model has to choose from… See the full description on the dataset page: https://huggingface.co/datasets/fireworks-ai/function-calling-eval-dataset-v0.