This model was created using knowledge distillation from the following teacher model(s):
A distilled model created using multi-modal knowledge distillation.
1from transformers import AutoModel, AutoTokenizer
2
3model = AutoModel.from_pretrained("fokan/train-modle2")
4tokenizer = AutoTokenizer.from_pretrained("bert-base-uncased")
This model was created using the Multi-Modal Knowledge Distillation platform.