In ad text generation (ATG), desirable ad text is both faithful and informative. That is, it should be faithful to the input document, while at the same time containing important information that appeals to potential customers.
The existing evaluation data, CAMERA (Mita et al.,2024), is suitable for evaluating informativeness, as it consists of reference ad texts created by ad creators. However, these references often include information unfaithful to the input, which is a… See the full description on the dataset page:
https://huggingface.co/datasets/cyberagent/FaithCAMERA.
