yyu/

news_contrastive_pretrain

The BERT model pretrained on the news corpus (https://huggingface.co/datasets/yyu/news_corpus). Used in the paper ReGen: Zero-Shot Text Classification via Training Data Generation with Progressive Dense Retrieval.

See github: https://github.com/yueyu1030/ReGen and paper: https://arxiv.org/abs/2305.10703 for details.