You can deploy this model and start earning money today!

RichardErkhov/
Keynote-Technology_-_TinyKAI-0.7B-v0.1-gguf

Name: Keynote-Technology_-_TinyKAI-0.7B-v0.1-gguf
Availability: InStock

endpoints_compatible

gguf

template

Views

No views yet

Quantization made by Richard Erkhov.

Github

Discord

Request more models

TinyKAI-0.7B-v0.1 - GGUF

Model creator: https://huggingface.co/Keynote-Technology/
Original model: https://huggingface.co/Keynote-Technology/TinyKAI-0.7B-v0.1/

Name	Quant method	Size
TinyKAI-0.7B-v0.1.Q2_K.gguf	Q2_K	0.08GB
TinyKAI-0.7B-v0.1.IQ3_XS.gguf	IQ3_XS	0.08GB
TinyKAI-0.7B-v0.1.IQ3_S.gguf	IQ3_S	0.08GB
TinyKAI-0.7B-v0.1.Q3_K_S.gguf	Q3_K_S	0.08GB
TinyKAI-0.7B-v0.1.IQ3_M.gguf	IQ3_M	0.09GB
TinyKAI-0.7B-v0.1.Q3_K.gguf	Q3_K	0.09GB
TinyKAI-0.7B-v0.1.Q3_K_M.gguf	Q3_K_M	0.09GB
TinyKAI-0.7B-v0.1.Q3_K_L.gguf	Q3_K_L	0.1GB
TinyKAI-0.7B-v0.1.IQ4_XS.gguf	IQ4_XS	0.1GB
TinyKAI-0.7B-v0.1.Q4_0.gguf	Q4_0	0.1GB
TinyKAI-0.7B-v0.1.IQ4_NL.gguf	IQ4_NL	0.1GB
TinyKAI-0.7B-v0.1.Q4_K_S.gguf	Q4_K_S	0.1GB
TinyKAI-0.7B-v0.1.Q4_K.gguf	Q4_K	0.11GB
TinyKAI-0.7B-v0.1.Q4_K_M.gguf	Q4_K_M	0.11GB
TinyKAI-0.7B-v0.1.Q4_1.gguf	Q4_1	0.11GB
TinyKAI-0.7B-v0.1.Q5_0.gguf	Q5_0	0.11GB
TinyKAI-0.7B-v0.1.Q5_K_S.gguf	Q5_K_S	0.11GB
TinyKAI-0.7B-v0.1.Q5_K.gguf	Q5_K	0.12GB
TinyKAI-0.7B-v0.1.Q5_K_M.gguf	Q5_K_M	0.12GB
TinyKAI-0.7B-v0.1.Q5_1.gguf	Q5_1	0.12GB
TinyKAI-0.7B-v0.1.Q6_K.gguf	Q6_K	0.13GB
TinyKAI-0.7B-v0.1.Q8_0.gguf	Q8_0	0.17GB

Original model description:

license: apache-2.0 tags:

code
safetensors
chatbot
0.7B
text-generation datasets:
Keynote-Technology/PLANE-2K
togethercomputer/RedPajama-Data-V2 pipeline_tag: text-generation

TinyKAI 0.7B

Model Details

TinyKAI-0.7B is one of the world's SMALLEST "large" language models EVER! We acheived such a feat by essentially compressing GPT2 and squeezing it to fit into one sub-GB pytorch.bin file!

Uses

Due to being one of the tiniest "large" language models on huggingface, many corners had to be cut. TinyKAI-0.7B has a max output of only 150 characters per computation (without repeating itself). Therefore, TinyKAI is only intended for research purposes.

Banned Use

TinyKAI-1B is governed by the apache 2.0 liscense, and therefore means that whatever the license deems unacceptable shall not be allowed. We specificaly ban the use of ANY AND ALL KAI MODELS for hate speech towards a paricular thing, person, our particular group due to legal and ethical issues.

Limitations

2K characters max output length, English only, and extremely tiny (1GB).

Recommendations

TinyKAI-0.7B is a very small model, and is good for AI research especially.

RichardErkhov/Keynote-Technology_-_TinyKAI-0.7B-v0.1-gguf