This model is made to be a good AI model with a custom architecture and it's going to be made from scratch entirely
and since this is a custom architecture you need to use the following python code
1
2from transformers import AutoConfig, AutoModel
3config = AutoConfig.from_pretrained("moelanoby/kok-base")
4model = AutoModel.from_config(config)
5
The previous script uses the correct implementation to do it
you can finetune this model to an LLM
you can use it for any use case and I won't care
and while you're at it you can support me with buy me a coffee :D
