Kite is a small, trained, 14 million parameter language model.
It was trained on a tokenized version of
qikp/small-data, which is a mixture of various datasets, using 1 epoch, 32 batch size, 1.5e-4 learning rate, and the
pika 4 tokenizer.
Due to its size, the model is not suitable for production workloads.
