Felladrin/

ChatML-Capybara

LDJnr/Capybara in ChatML format, ready to use in HuggingFace TRL's SFT Trainer. Python code used for conversion: from datasets import load_dataset from transformers import AutoTokenizer

tokenizer = AutoTokenizer.from_pretrained("Felladrin/Llama-160M-Chat-v1")

dataset = load_dataset("LDJnr/Capybara", split="train")

def format(columns): messages = [] conversationColumn = columns["conversation"]

for i in range(len(conversationColumn)):
    messages.append({
        "role":… See the full description on the dataset page: https://huggingface.co/datasets/Felladrin/ChatML-Capybara.