You can deploy this model and start earning money today!

RichardErkhov/
abacusai_-_Giraffe-13b-32k-v3-gguf

Name: abacusai_-_Giraffe-13b-32k-v3-gguf
Availability: InStock

endpoints_compatible

gguf

template

Views

No views yet

Quantization made by Richard Erkhov.

Github

Discord

Request more models

Giraffe-13b-32k-v3 - GGUF

Model creator: https://huggingface.co/abacusai/
Original model: https://huggingface.co/abacusai/Giraffe-13b-32k-v3/

Name	Quant method	Size
Giraffe-13b-32k-v3.Q2_K.gguf	Q2_K	4.52GB
Giraffe-13b-32k-v3.IQ3_XS.gguf	IQ3_XS	4.99GB
Giraffe-13b-32k-v3.IQ3_S.gguf	IQ3_S	5.27GB
Giraffe-13b-32k-v3.Q3_K_S.gguf	Q3_K_S	5.27GB
Giraffe-13b-32k-v3.IQ3_M.gguf	IQ3_M	5.57GB
Giraffe-13b-32k-v3.Q3_K.gguf	Q3_K	5.9GB
Giraffe-13b-32k-v3.Q3_K_M.gguf	Q3_K_M	5.9GB
Giraffe-13b-32k-v3.Q3_K_L.gguf	Q3_K_L	6.45GB
Giraffe-13b-32k-v3.IQ4_XS.gguf	IQ4_XS	6.54GB
Giraffe-13b-32k-v3.Q4_0.gguf	Q4_0	6.86GB
Giraffe-13b-32k-v3.IQ4_NL.gguf	IQ4_NL	6.9GB
Giraffe-13b-32k-v3.Q4_K_S.gguf	Q4_K_S	6.91GB
Giraffe-13b-32k-v3.Q4_K.gguf	Q4_K	7.33GB
Giraffe-13b-32k-v3.Q4_K_M.gguf	Q4_K_M	7.33GB
Giraffe-13b-32k-v3.Q4_1.gguf	Q4_1	7.61GB
Giraffe-13b-32k-v3.Q5_0.gguf	Q5_0	8.36GB
Giraffe-13b-32k-v3.Q5_K_S.gguf	Q5_K_S	8.36GB
Giraffe-13b-32k-v3.Q5_K.gguf	Q5_K	8.6GB
Giraffe-13b-32k-v3.Q5_K_M.gguf	Q5_K_M	8.6GB
Giraffe-13b-32k-v3.Q5_1.gguf	Q5_1	9.1GB
Giraffe-13b-32k-v3.Q6_K.gguf	Q6_K	9.95GB
Giraffe-13b-32k-v3.Q8_0.gguf	Q8_0	12.88GB

Original model description:

datasets:

togethercomputer/RedPajama-Data-1T
shahules786/orca-chat
anon8231489123/ShareGPT_Vicuna_unfiltered tags:
llama2 license: llama2

Model Card for Model ID

Llama2 13B finetuned to process longer (32K) contexts using interpolation and then further instruct finetuned with ShareGPT and Orca-Chat.

Model Details

Model Description

This is next version of the model trained and evaluated as part of the experiments described in the repo http://github.com/abacusai/Long-Context. This version was trained with a scaling factor of 8 and shows better reasoning and math abilites on State of the Art benchmarks

Developed by: Abacus.AI
Model type: Transformer based autoregressive causal language model
License: Llama 2 Community License: https://github.com/facebookresearch/llama/blob/main/LICENSE
Finetuned from model: Llama V2 13B

Model Sources [optional]

Repository: http://github.com/abacusai/Long-Context

Direct Use

Since the model is instruct finetuned it can also be directly used for various prompted tasks. We have tested it on open book question answering using the long context to supply search results.

Bias, Risks, and Limitations

The model has not been evaluated for safety and is only intended for research and experiments.

RichardErkhov/abacusai_-_Giraffe-13b-32k-v3-gguf