You can deploy this model and start earning money today!

RichardErkhov/
meditsolutions_-_Llama-3.2-SUN-2.5B-chat-gguf

Name: meditsolutions_-_Llama-3.2-SUN-2.5B-chat-gguf
Availability: InStock

Views

No views yet

Quantization made by Richard Erkhov.

Github

Discord

Request more models

Llama-3.2-SUN-2.5B-chat - GGUF

Model creator: https://huggingface.co/meditsolutions/
Original model: https://huggingface.co/meditsolutions/Llama-3.2-SUN-2.5B-chat/

Name	Quant method	Size
Llama-3.2-SUN-2.5B-chat.Q2_K.gguf	Q2_K	0.95GB
Llama-3.2-SUN-2.5B-chat.Q3_K_S.gguf	Q3_K_S	1.09GB
Llama-3.2-SUN-2.5B-chat.Q3_K.gguf	Q3_K	1.18GB
Llama-3.2-SUN-2.5B-chat.Q3_K_M.gguf	Q3_K_M	1.18GB
Llama-3.2-SUN-2.5B-chat.Q3_K_L.gguf	Q3_K_L	1.26GB
Llama-3.2-SUN-2.5B-chat.IQ4_XS.gguf	IQ4_XS	1.32GB
Llama-3.2-SUN-2.5B-chat.Q4_0.gguf	Q4_0	1.37GB
Llama-3.2-SUN-2.5B-chat.IQ4_NL.gguf	IQ4_NL	1.38GB
Llama-3.2-SUN-2.5B-chat.Q4_K_S.gguf	Q4_K_S	1.37GB
Llama-3.2-SUN-2.5B-chat.Q4_K.gguf	Q4_K	1.43GB
Llama-3.2-SUN-2.5B-chat.Q4_K_M.gguf	Q4_K_M	1.43GB
Llama-3.2-SUN-2.5B-chat.Q4_1.gguf	Q4_1	1.49GB
Llama-3.2-SUN-2.5B-chat.Q5_0.gguf	Q5_0	1.62GB
Llama-3.2-SUN-2.5B-chat.Q5_K_S.gguf	Q5_K_S	1.62GB
Llama-3.2-SUN-2.5B-chat.Q5_K.gguf	Q5_K	1.66GB
Llama-3.2-SUN-2.5B-chat.Q5_K_M.gguf	Q5_K_M	1.66GB
Llama-3.2-SUN-2.5B-chat.Q5_1.gguf	Q5_1	1.75GB
Llama-3.2-SUN-2.5B-chat.Q6_K.gguf	Q6_K	1.9GB
Llama-3.2-SUN-2.5B-chat.Q8_0.gguf	Q8_0	2.45GB

Original model description:

language:

en license: llama3.2 library_name: transformers base_model:
meta-llama/Llama-3.2-1B-Instruct datasets:
argilla/OpenHermesPreferences
argilla/magpie-ultra-v0.1
argilla/Capybara-Preferences-Filtered
mlabonne/open-perfectblend
HuggingFaceTB/everyday-conversations-llama3.1-2k
WizardLMTeam/WizardLM_evol_instruct_V2_196k
ProlificAI/social-reasoning-rlhf pipeline_tag: text-generation

MedIT SUN 2.5B

Base Model

Llama 3.2 1B

Extended Size

1B to 2.5B parameters

Extension Method

Proprietary technique developed by MedIT Solutions

Fine-tuning

Open (or open subsets allowing for commercial use) open datasets from HF
Open (or open subsets allowing for commercial use) SFT datasets from HF

Training Status

Current version: chat-1.0.0

Key Features

Built on Llama 3.2 architecture
Expanded from 1B to 2.47B parameters
Optimized for open-ended conversations
Incorporates supervised fine-tuning for improved performance

Use Case

General conversation and task-oriented interactions

Limitations As the model is still in training, performance and capabilities may vary. Users should be aware that the model is not in its final form and may exhibit inconsistencies or limitations typical of in-progress AI models.

Disclaimer and Safety Considerations The Model is designed to be used as a smart assistant but not as a knowledge source within your applications, systems, or environments. It is not intended to provide 100% accurate answers, especially in scenarios where high precision and accuracy are

RichardErkhov/meditsolutions_-_Llama-3.2-SUN-2.5B-chat-gguf

Original model description:

MedIT SUN 2.5B

RichardErkhov/
meditsolutions_-_Llama-3.2-SUN-2.5B-chat-gguf