Views
No views yet
transformers
tokenizers
1from transformers import PreTrainedTokenizerFast 2tokenizer = PreTrainedTokenizerFast.from_pretrained("goabonga/wikitext-2-raw-v1")