🧠 Osmosis-Structure 0.6B (GGUF)

📦 Model Overview

• Model Size: 0.6 Billion parameters
• Quantization: Q4_K_M
• Format: GGUF
• Tokenizer: SentencePiece (tokenizer.model)
• Usage: Optimized for fast inference with low memory requirements

🧰 How to Use

• llama.cpp
• llama-cpp-python
• llm

Example command using llama.cpp:

📁 Files Included

• Osmosis-Structure-0.6B-Q4_K_M.gguf
• tokenizer.model
• README.md

⚠️ License & Usage

✨ Maintained by