Hunyuan-PythonGOD-0.5B-GGUF

Name: Hunyuan-Python.GOD-0.5B-GGUF
Availability: InStock

Hunyuan-PythonGOD-0.5B-GGUF is a compact Python-specialized coding model released in GGUF format for lightweight local inference. It is derived from a full fine-tune of tencent/Hunyuan-0.5B-Instruct and is aimed at code generation, Python scripting, debugging help, implementation tasks, and coding-oriented chat workflows.

This repo provides quantized GGUF builds for efficient use with llama.cpp-compatible runtimes and other GGUF-serving backends.

Model Details

Base Model

Base model: tencent/Hunyuan-0.5B-Instruct
Architecture: Causal decoder-only language model
Parameter scale: ~0.5B
Specialization: Python coding and general code-assistant behavior
Release format: GGUF

Included Files

Hunyuan-PythonGOD-0.5B.Q4_K_M.gguf
Hunyuan-PythonGOD-0.5B.Q5_K_M.gguf
Hunyuan-PythonGOD-0.5B.f16.gguf

Training Summary

This GGUF release is based on a full fine-tune, not an adapter-only export.

Training Datasets

WithinUsAI/Python_GOD_Coder_Omniforge_AI_12k
WithinUsAI/Python_GOD_Coder_5k
WithinUsAI/Legend_Python_CoderV.1

Training Characteristics

Full-parameter fine-tuning
Python/code-oriented instruction tuning
Exported as standard model weights before GGUF conversion
Intended for compact coding assistance and local inference experimentation

Intended Uses

Good Fits

Python function generation
Python script writing
Debugging assistance
Automation script drafting
Code-oriented local assistants
Small-model coding experiments

Not Intended For

Safety-critical software deployment without review
Autonomous execution without sandboxing
Guaranteed bug-free or secure code generation
Medical, legal, or financial decision support

Quantization Notes-

This repo includes multiple tradeoff points:

Q4_K_M: smaller footprint, faster/lighter inference
Q5_K_M: stronger quality-to-size balance
F16: highest fidelity in this repo, larger memory cost

Example llama.cpp Usage

./llama-cli -m Hunyuan-PythonGOD-0.5B.Q5_K_M.gguf -p "Write a Python function that validates an email address." -n 256

11-47/Hunyuan-Python.GOD-0.5B-GGUF