Views
No views yet
bf16 GGUF quantization of the NeuTTS-Nano acoustic inference model. Optimized specifically for low-latency, high-efficiency edge execution using llama.cpp or compatible GGUF runtimes.outtype: bf16)bf16)llama.cpp, utilize the following configurations.1llama-cli -m neutts-nano-bf16.gguf -p "Your input text prompt here" --threads 4
21llama-server -m neutts-nano-bf16.gguf --port 8080 --host 0.0.0.0
2