Guanaco-1k for Llama3
I took a page out of mlabonne's book and made a subset of the original timdettmers/openassistant-guanaco
dataset that matches the Llama3 formatting. I used the same colab notebook as the original. Here's the changed code
from datasets import load_dataset
import re
Load the dataset
dataset = load_dataset('timdettmers/openassistant-guanaco')
Shuffle the dataset and slice it
dataset = dataset['train'].shuffle(seed=42).select(range(1000))