Note 0: This is an unflattened version of the dataset where each line of the dataset may contain multiple labelled turns. If you would like a flattened version where each line contains only one labelled turn please use UltraSteer-v0-flat.
UltraSteer is a large-scale dataset of single- and multi-turn dialogue with fine-grained labels produced by Nvidia's Llama2-13B-SteerLM-RM reward model using the NeMo… See the full description on the dataset page:
https://huggingface.co/datasets/Avelina/UltraSteer-v0.