This repository provides a lightweight, structured catalog of recommended GGUF models
for use with the Sonia on-device music generation engine.
It does not contain any model weights — only metadata and download links to publicly
available models hosted on HuggingFace.
Purpose
The Sonia app allows users to download and run local Large Language Models (LLMs) directly
on their device for offline symbolic music generation.
This catalog serves as a centralized, versioned list of supported models, including:
Model names
Official source URLs
Recommended quantizations
File sizes
SHA‑256 checksums (for integrity verification)
The app reads this catalog to present available models to the user and manage downloads.
File Structure
catalog.json # List of supported GGUF models with URLs and metadata
README.md # You are here
Example Entry (from catalog.json)
json
1{2"id":"Phi-3.5-mini-instruct",3"name":"Phi-3.5 Mini Instruct (1.6B)",4"description":"Fast and lightweight model suitable for on-device symbolic music generation.",5"size_mb":700,6"url":"https://huggingface.co/microsoft/Phi-3.5-mini-instruct-gguf/resolve/main/Phi-3.5-mini-instruct-Q4_K_M.gguf",7"sha256":"REPLACE_WITH_SHA256"8}
How Sonia Uses This Catalog
Fetches the file catalog.json from this repository.
Displays the available models to the user.
Downloads the selected GGUF file from its official source URL.
Validates file integrity using the provided SHA‑256 hash.
Loads the model via the on-device Llama.cpp backend.
This approach ensures:
The app remains lightweight
Models are always up to date
Users choose the model best suited to their device
No redistribution of model weights within this repo
Updating the Catalog
To update or add models:
Edit catalog.json
Add or update model entries
Provide accurate SHA‑256 checksums
Commit and push
Sonia automatically picks up new models without requiring an app update.
License
This repository contains metadata only and no model weights.
All referenced models remain under their respective licenses hosted on HuggingFace.