NeuTTS-Nano-French (BF16 GGUF)
This repository contains the official bf16 GGUF quantization of the NeuTTS-Nano acoustic inference model. Optimized specifically for low-latency, high-efficiency edge execution using llama.cpp or compatible GGUF runtimes.
Model Details
Architecture: NeuTTS-NanoFormat: GGUF (outtype: bf16)File Size: 446 MBPrecision: Brain Floating Point 16-bit (bf16)Primary Use Case: Real-time acoustic processing, voice generation, low-latency edge speech pipelines.
Deployment & Inference
To run this model locally via the CLI or spin up a local inference server using llama.cpp, utilize the following configurations.
CLI Benchmark
llama-cli -m neutts-nano-bf16.gguf -p "Your input text prompt here" --threads 4Local Inference Server
llama-server -m neutts-nano-bf16.gguf --port 8080 --host 0.0.0.0Language Variants
If you are looking for specific regional acoustic profiles, distinct variants are isolated in their own standalone repositories:
