You can deploy this model and start earning money today!

farid678/
Orphues_Q4_K_M

Name: Orphues_Q4_K_M
Availability: InStock

Views

No views yet

Orphues_Q4_K_M

This repository contains a quantized GGUF version (Q4_K_M) of an Orpheus-based Text-to-Speech model, fine-tuned using Unsloth for efficient training and inference.

⚠️ Note:
This model is NOT trained or fine-tuned on Persian (Farsi) data.
It is intended for non-Persian (primarily English) text-to-speech use cases.

🔊 Model Overview

Base architecture: Orpheus TTS (LLM-based Audio Generation)
Backbone: LLaMA-style Transformer
Fine-tuning framework: Unsloth
Quantization: Q4_K_M (GGUF)
Inference target: llama.cpp / GGUF-compatible runtimes
Language support: Non-Persian (English-focused)

🧠 About Orpheus TTS

Orpheus is a modern LLM-based Text-to-Speech architecture that generates audio by predicting audio tokens instead of mel-spectrograms.
It enables:

Natural prosody
Expressive speech
Low-latency generation
Zero-shot or few-shot voice adaptation (depending on setup)

This model follows that paradigm and has been adapted via fine-tuning.

🛠️ Fine-Tuning Details

Fine-tuning method: LoRA-based fine-tuning via Unsloth
Training focus: Improving speech naturalness and stability
Tokenizer: Original LLaMA-compatible tokenizer
No Persian data used

⚙️ Quantization Details

Format: GGUF
Quantization type: Q4_K_M
Optimized for:
- Reduced VRAM usage
- Fast CPU/GPU inference
Recommended runtime: llama.cpp (latest version)

🚀 Usage Example (llama.cpp)

bash

./main \
  -m Orphues_Q4_K_M.gguf \
  --temp 0.7 \
  --ctx-size 4096

farid678/Orphues_Q4_K_M