You can deploy this model and start earning money today!

RichardErkhov/
hon9kon9ize_-_Cantonese-Llama-2-7B-preview20240625-gguf

Name: hon9kon9ize_-_Cantonese-Llama-2-7B-preview20240625-gguf
Availability: InStock

endpoints_compatible

gguf

template

Views

No views yet

Quantization made by Richard Erkhov.

Github

Discord

Request more models

Cantonese-Llama-2-7B-preview20240625 - GGUF

Model creator: https://huggingface.co/hon9kon9ize/
Original model: https://huggingface.co/hon9kon9ize/Cantonese-Llama-2-7B-preview20240625/

Name	Quant method	Size
Cantonese-Llama-2-7B-preview20240625.Q2_K.gguf	Q2_K	2.36GB
Cantonese-Llama-2-7B-preview20240625.IQ3_XS.gguf	IQ3_XS	2.6GB
Cantonese-Llama-2-7B-preview20240625.IQ3_S.gguf	IQ3_S	2.75GB
Cantonese-Llama-2-7B-preview20240625.Q3_K_S.gguf	Q3_K_S	2.75GB
Cantonese-Llama-2-7B-preview20240625.IQ3_M.gguf	IQ3_M	2.9GB
Cantonese-Llama-2-7B-preview20240625.Q3_K.gguf	Q3_K	3.07GB
Cantonese-Llama-2-7B-preview20240625.Q3_K_M.gguf	Q3_K_M	3.07GB
Cantonese-Llama-2-7B-preview20240625.Q3_K_L.gguf	Q3_K_L	3.35GB
Cantonese-Llama-2-7B-preview20240625.IQ4_XS.gguf	IQ4_XS	3.4GB
Cantonese-Llama-2-7B-preview20240625.Q4_0.gguf	Q4_0	3.56GB
Cantonese-Llama-2-7B-preview20240625.IQ4_NL.gguf	IQ4_NL	3.58GB
Cantonese-Llama-2-7B-preview20240625.Q4_K_S.gguf	Q4_K_S	3.59GB
Cantonese-Llama-2-7B-preview20240625.Q4_K.gguf	Q4_K	3.8GB
Cantonese-Llama-2-7B-preview20240625.Q4_K_M.gguf	Q4_K_M	3.8GB
Cantonese-Llama-2-7B-preview20240625.Q4_1.gguf	Q4_1	3.95GB
Cantonese-Llama-2-7B-preview20240625.Q5_0.gguf	Q5_0	4.33GB
Cantonese-Llama-2-7B-preview20240625.Q5_K_S.gguf	Q5_K_S	4.33GB
Cantonese-Llama-2-7B-preview20240625.Q5_K.gguf	Q5_K	4.45GB
Cantonese-Llama-2-7B-preview20240625.Q5_K_M.gguf	Q5_K_M	4.45GB
Cantonese-Llama-2-7B-preview20240625.Q5_1.gguf	Q5_1	4.72GB
Cantonese-Llama-2-7B-preview20240625.Q6_K.gguf	Q6_K	5.15GB
Cantonese-Llama-2-7B-preview20240625.Q8_0.gguf	Q8_0	6.67GB

Original model description:

license: cc-by-sa-4.0 base_model: meta-llama/Llama-2-7b language:

yue pipeline_tag: text-generation tags:
cantonese
llama-2
Powered by AWS Trainium

Cantonese LLM using Llama-2 7B Architecture

Welcome to the preview of the Cantonese Language Model (LLM) built on the Llama-2 7B architecture. This model is designed to understand and generate text in Cantonese, including slangs, colloquials, and Internet terms.

License

This project is available under the Creative Commons Attribution-ShareAlike 4.0 International License (CC BY-SA 4.0). For more details, please visit the license page.

Preview Warning

Please be advised that this version of the Cantonese LLM is a preview. As such, the model's outputs may sometimes be inaccurate, hallucinatory, or potentially offensive to some individuals. We are continuously working to improve the model's accuracy and reduce such instances.

Training Infrastructure

The Cantonese LLM has been trained using Amazon HyperPod and AWS Trainium chips.

Training Credits

This model was trained by Votee AI Limited, and we contribute to hon9kon9ize, the Hong Kong AI Research Community.

Usage Guidelines

Ensure that you are aware of the potential for unexpected or offensive content.
Always review and assess the model's output before using it in any application.
Provide feedback on any issues you encounter to help us improve the model.

Contributions

We welcome contributions from the community. If you have suggestions or improvements, please submit a pull request or open an issue in the project repository.

Disclaimer

The developers of the Cantonese LLM are not responsible for any harm or offense caused by the model's outputs. Users are advised to exercise discretion and judgment when using the model.

Thank you for exploring the Cantonese LLM. We are excited to see the innovative ways in which it will be used!

RichardErkhov/hon9kon9ize_-_Cantonese-Llama-2-7B-preview20240625-gguf