You can deploy this model and start earning money today!

sthaps/
typhoon-si-med-thinking-4b-research-preview-gguf

Name: typhoon-si-med-thinking-4b-research-preview-gguf
Availability: InStock

Views

No views yet

typhoon-si-med-thinking-4b-research-preview - GGUF

For a convenient overview and download list, visit our model page.

If you are unsure how to use GGUF files, refer to the llama.cpp documentation for more details.

./llama-cli -m typhoon-si-med-thinking-4b-research-preview-q4_k_m.gguf -p "Hello!"

(sorted by size, not necessarily quality)

Link	Type	Size/GB	Notes
GGUF	q2_k	1.67	very low quality, for testing
GGUF	q3_k_m	2.09
GGUF	q4_0	2.41
GGUF	q4_k_m	2.53	recommended, good balance
GGUF	q5_k_m	2.94
GGUF	q8_0	4.37	near-full precision

Special thanks to the llama.cpp team for their amazing work.