Auralis 🌌
Model Details 🛠️
Model Name: Auralis
Model Architecture: Based on
Coqui XTTS-v2
License:
- license: Apache 2.0
- base_model: XTTS-v2 Components Coqui AI License
Language Support: English, Spanish, French, German, Italian, Portuguese, Polish, Turkish, Russian, Dutch, Czech, Arabic, Chinese (Simplified), Hungarian, Korean, Japanese, Hindi
Developed by: AstraMind.ai
Primary Use Case: Text-to-Speech (TTS) generation for real-world applications, including books, dialogues, and multilingual tasks.
Model Description 🚀
Auralis transforms text into natural, high-quality speech with exceptional speed and scalability. It is powered by
Coqui XTTS-v2 and optimized for both consumer-grade and high-performance GPUs. Auralis is designed to meet real-world needs like long-text processing, voice cloning, and concurrent request handling.
Key Features:
- Warp-Speed Processing: Generate speech for an entire novel (e.g., Harry Potter) in ~10 minutes.
- Hardware Friendly: Requires <10GB VRAM on a single NVIDIA RTX 3090.
- Scalable: Handles multiple requests simultaneously.
- Streaming: Seamlessly processes long texts in a streaming format.
- Custom Voices: Enables voice cloning from short reference audio.
Quick Start ⭐
1from auralis import TTS, TTSRequest
2
3# Initialize the model
4tts = TTS().from_pretrained("AstraMindAI/xtts2-gpt")
5
6# Create a TTS request
7request = TTSRequest(
8 text="Hello Earth! This is Auralis speaking.",
9 speaker_files=["reference.wav"]
10)
11
12# Generate speech
13output = tts.generate_speech(request)
14output.save("output.wav")
Ebook Generation 📚
Auralis converting ebooks into audio formats at lightning speed. For Python script, check out
ebook_audio_generator.py.
1def process_book(chapter_file: str, speaker_file: str):
2 # Read chapter
3 with open(chapter_file, 'r') as f:
4 chapter = f.read()
5
6 # You can pass the whole book, auralis will take care of splitting
7
8 request = TTSRequest(
9 text=chapter,
10 speaker_files=[speaker_file],
11 audio_config=AudioPreprocessingConfig(
12 enhance_speech=True,
13 normalize=True
14 )
15 )
16
17 output = tts.generate_speech(request)
18
19 output.play()
20 output.save("chapter_output.wav")
21
22# Example usage
23process_book("chapter1.txt", "reference_voice.wav")
Intended Use 🌟
Auralis is designed for:
- Content Creators: Generate audiobooks, podcasts, or voiceovers.
- Developers: Integrate TTS into applications via a simple Python API.
- Accessibility: Providing audio versions of digital content for people with visual or reading difficulties.
- Multilingual Scenarios: Convert text to speech in multiple supported languages.
Performance 📊
Benchmarks on NVIDIA RTX 3090:
- Short phrases (<100 characters): ~1 second
- Medium texts (<1,000 characters): ~5-10 seconds
- Full books (~100,000 characters): ~10 minutes
Memory Usage:
- Base VRAM: ~4GB
- Peak VRAM: ~10GB
Model Features 🛸
-
Speed & Efficiency:
- Smart batching for rapid processing of long texts.
- Memory-optimized for consumer GPUs.
-
Easy Integration:
- Python API with support for synchronous and asynchronous workflows.
- Streaming mode for continuous playback during generation.
-
Audio Quality Enhancements:
- Background noise reduction.
- Voice clarity and volume normalization.
- Customizable audio preprocessing.
-
Multilingual Support:
- Automatic language detection.
- High-quality speech in 15+ languages.
-
Customization:
- Voice cloning using short reference clips.
- Adjustable parameters for tone, pacing, and language.
Limitations & Ethical Considerations ⚠️
- Voice Cloning Risks: Auralis supports voice cloning, which may raise ethical concerns about misuse. Use responsibly and ensure proper consent.
- Accent Limitations: While robust for many languages, accents and intonations may vary based on the input.
Citation 📜
If you use Auralis in your research or projects, please cite:
1@misc{auralis2024,
2 author = {AstraMind AI},
3 title = {Auralis: High-Performance Text-to-Speech Engine},
4 year = {2024},
5 url = {https://huggingface.co/AstraMindAI/auralis}
6}
