List of sample identifiers from ATB, GTDB, MGnify, SPIRE, mOTUs and HRGM datasets, deduplicated at varying levels of identity based on nucleotide sequence using sketchlib v0.2.5.
Sketching and distance calculation conducted with below commands
sketchlib inverted build -o ${outpref} -k 21 -s 10 -f ${infile} --threads 47 --write-skq
sketchlib sketch -f ${infile} -o ${outpref} --k-vals 21 -s 1000 --threads 47
sketchlib inverted precluster --knn 50 --skd ${outpref} --ani --threads 47 -o… See the full description on the dataset page:
https://huggingface.co/datasets/AllTheBacteria/All-representative-ids.
