brew install llama.cpp 
pip install huggingface_hub 
hf download tiiuae/Falcon-H1-Tiny-R-0.6B-GGUF Falcon-H1-Tiny-R-0.6B-GGUF-Q8_0.gguf --local-dir ./ 
llama-cli ./Falcon-H1-Tiny-R-0.6B-GGUF-Q8_0.gguf -cnv 

`ollama`

ollama run hf.co/tiiuae/Falcon-H1-Tiny-R-0.6B-GGUF:Q8_0

Evaluation

For detailed evaluation of Falcon-H1-Tiny series, please refer to our technical blogpost

Useful links

View our release blogpost.
Feel free to join our discord server if you have any questions or to interact with our researchers and developers.

Citation

If the Falcon-H1-Tiny family of models were helpful to your work, feel free to give us a cite.

@misc{falcon_h1_tiny,
  title={Falcon-H1-Tiny: A series of extremely small, yet powerful language models redefining capabilities at small scale},
  author={Falcon-LLM Team},
  year={2026}, 
}

tiiuae/Falcon-H1-Tiny-R-0.6B-GGUF

Table of Contents

TL;DR

Model Details

Model Description

Training details

Usage

Inference

llama.cpp

ollama

Evaluation

Useful links

Citation

tiiuae/
Falcon-H1-Tiny-R-0.6B-GGUF

`llama.cpp`

`ollama`