Dataset generated using meta-llama/Meta-Llama-3-70B-Instruct with the MAGPIE codebase.
The unfiltered dataset can be found here: HiTZ/Magpie-Llama-3-70B-Instruct-Unfiltered
def high_quality_filter(example):
return (
example["input_quality"] in ["good", "excellent", "average"]
and example["instruct_reward"] > -10
and not example["instruction"].endswith(":")
and (
example["min_similar_conversation_id"] is None… See the full description on the dataset page:
https://huggingface.co/datasets/HiTZ/Magpie-Llama-3-70B-Instruct-Filtered.