llama-3.2-1b-instruct-gguf is a GGUF Q4_K_M int4 quantized version of Llama 3.2 1B Instruct, providing a very small, very fast inference implementation, optimized for AI PCs.

llama-3.2-1b-instruct is a new 1B chat foundation model from Meta.

Model Description

Developed by: meta-llama
Quantized by: llmware
Model type: llama-3.2
Parameters: 1 billion
Model Parent: meta-llama/Meta-Llama-3.2-1B-Instruct
Language(s) (NLP): English
License: Llama 3.2 Community License
Uses: General chat use cases
RAG Benchmark Accuracy Score: NA
Quantization: int4

Model Card Contact

llmware on github

llmware on hf

llmware website

llmware/llama-3.2-1b-gguf

llama-3.2-1b-instruct-gguf

Model Description

Model Card Contact

llmware/
llama-3.2-1b-gguf