You can deploy this model and start earning money today!

undefinelabs/
neutts-nano

Name: neutts-nano
Availability: InStock

Views

No views yet

NeuTTS-Nano (BF16 GGUF)

This repository contains the official bf16 GGUF quantization of the NeuTTS-Nano acoustic inference model. Optimized specifically for low-latency, high-efficiency edge execution using llama.cpp or compatible GGUF runtimes.

Model Details

Architecture: NeuTTS-Nano
Format: GGUF (outtype: bf16)
File Size: 446 MB
Precision: Brain Floating Point 16-bit (bf16)
Primary Use Case: Real-time acoustic processing, voice generation, low-latency edge speech pipelines.

Deployment & Inference

To run this model locally via the CLI or spin up a local inference server using llama.cpp, utilize the following configurations.

CLI Benchmark

bash

llama-cli -m neutts-nano-bf16.gguf -p "Your input text prompt here" --threads 4

Local Inference Server