Original dataset size: 1000000
Size after removing duplicates: 960713
Size after filtering redacted entries: 697215
Size after filtering duplicate entries: 674651
Size after filtering models ['gpt-4', 'claude-2', 'palm-2', 'gpt-3.5-turbo', 'claude-instant-1']: 17257
