You can deploy this model and start earning money today!

RichardErkhov/
huggyllama_-_llama-30b-gguf

Name: huggyllama_-_llama-30b-gguf
Availability: InStock

endpoints_compatible

gguf

template

Views

No views yet

Quantization made by Richard Erkhov.

Github

Discord

Request more models

llama-30b - GGUF

Model creator: https://huggingface.co/huggyllama/
Original model: https://huggingface.co/huggyllama/llama-30b/

Name	Quant method	Size
llama-30b.Q2_K.gguf	Q2_K	11.22GB
llama-30b.IQ3_XS.gguf	IQ3_XS	12.4GB
llama-30b.IQ3_S.gguf	IQ3_S	13.1GB
llama-30b.Q3_K_S.gguf	Q3_K_S	13.1GB
llama-30b.IQ3_M.gguf	IQ3_M	13.86GB
llama-30b.Q3_K.gguf	Q3_K	14.69GB
llama-30b.Q3_K_M.gguf	Q3_K_M	14.69GB
llama-30b.Q3_K_L.gguf	Q3_K_L	16.09GB
llama-30b.IQ4_XS.gguf	IQ4_XS	16.28GB
llama-30b.Q4_0.gguf	Q4_0	17.1GB
llama-30b.IQ4_NL.gguf	IQ4_NL	17.19GB
llama-30b.Q4_K_S.gguf	Q4_K_S	17.21GB
llama-30b.Q4_K.gguf	Q4_K	18.27GB
llama-30b.Q4_K_M.gguf	Q4_K_M	18.27GB
llama-30b.Q4_1.gguf	Q4_1	18.98GB
llama-30b.Q5_0.gguf	Q5_0	20.86GB
llama-30b.Q5_K_S.gguf	Q5_K_S	20.86GB
llama-30b.Q5_K.gguf	Q5_K	21.46GB
llama-30b.Q5_K_M.gguf	Q5_K_M	21.46GB
llama-30b.Q5_1.gguf	Q5_1	22.74GB
llama-30b.Q6_K.gguf	Q6_K	24.85GB
llama-30b.Q8_0.gguf	Q8_0	32.19GB

Original model description:

license: other

This contains the weights for the LLaMA-30b model. This model is under a non-commercial license (see the LICENSE file). You should only use this repository if you have been granted access to the model by filling out this form but either lost your copy of the weights or got some trouble converting them to the Transformers format.

RichardErkhov/huggyllama_-_llama-30b-gguf

Original model description:

license: other

RichardErkhov/
huggyllama_-_llama-30b-gguf