10 million random examples from Uniref50 representative sequences (October 2023) and computed selfies strings. The strings are stored as input ids from a custom selfies tokenizer. A BERT tokenizer with this vocabulary has been uploaded to this dataset under the files.
You can access the tokenizer like this:
import os
from huggingface_hub import hf_hub_download
from transformers import AutoTokenizer
repo_path = 'Synthyra/ProteinSelfies'
local_path = 'ProteinSelfies'
files =… See the full description on the dataset page:
https://huggingface.co/datasets/Synthyra/ProteinSelfies.