tasksource/

icl-symbol-tuning-instruct

Few-shot prompting demonstrates that language models can learn in context even though they were not trained to do. However, explicitly learning to learn in context meta-icl leads to better results. With symbol tuning, labels are replaced with arbitrary symbols (e.g. foo/bar), which makes learning in context a key condition to learn the instructions We implement symbol tuning, as presented in the Symbol tuning improves in-context learning paper with tasksource… See the full description on the dataset page: https://huggingface.co/datasets/tasksource/icl-symbol-tuning-instruct.