Dataset Card for Isotonic/SlimOrca
Dataset Summary
This dataset is a deduplicated version of Open-Orca/OpenOrca
MinHash Deduplication with Jaccard Threshold = 0.80
Original dataset size: 4233923
Number of duplicate clusters: 522077
Files in duplicate cluster: 2115143
Unique files in duplicate cluster: 892638
Filtered dataset size: 3011418