Views
No views yet
1from transformers import AutoTokenizer, BertForMaskedLM
2
3tokenizer = AutoTokenizer.from_pretrained('dicta-il/BEREL_3.0')
4model = BertForMaskedLM.from_pretrained('dicta-il/BEREL_3.0')
5
6# for evaluation, disable dropout
7model.eval()NOTE: This code will not work and provide bad results if you useBertTokenizer. Please useAutoTokenizerorBertTokenizerFast.