Cuckoo: An IE Free Rider Hatched by Massive Nutrition in LLM's Nest is a small (300M) information extraction (IE) model that imitates the next token prediction paradigm of large language models. Instead of retrieving from the vocabulary, Cuckoo predicts the next tokens by tagging them in the given input context as shown below:
Cuckoo is substantially different from previous IE pre-training because it can use any text resource to enhance itself, especially by… See the full description on the dataset page:
https://huggingface.co/datasets/KomeijiForce/Cuckoo_C4_Super_Rainbow.
