devnen / Chatterbox-TTS-Server
Self-host the powerful Chatterbox TTS model. This server offers a user-friendly Web UI, flexible API endpoints (incl. OpenAI compatible), predefined voices, voice cloning, and large audiobook-scale text processing. Runs accelerated on NVIDIA (CUDA), AMD (ROCm), and CPU.
Why this job: says: voice cloning, tts; topics: text-to-speech, tts, voice-cloning, speech-synthesis, audio-generation
What it does
- DGX Spark / sm_121 support via the new docker-compose-cu130.yml (CUDA 13.0, PyTorch 2.10). RTX 30/40/50 keep using cu121 / cu128.
- AMD Strix Halo support via docker-compose-strixhalo.yml (ROCm 7.2, HSA_OVERRIDE_GFX_VERSION=11.0.0).
- Streaming /tts endpoint. opt-in stream: true parameter returns a StreamingResponse that flushes WAV bytes per chunk with 20 ms crossfades. Default behavior unchanged.
- Voice conditioning cache. repeated requests against the same reference voice skip re-encoding. Real latency win for batch / OpenAI-endpoint workflows.
- Opt-in BF16 inference. TTS_BF16=on (or =auto) converts T3 to bfloat16 and runs under autocast for ~40% throughput on bf16-capable GPUs. Default off to preserve existing behavior on upgrade.
Get started
git clone https://github.com/devnen/Chatterbox-TTS-Server.git
cd Chatterbox-TTS-Server # Make the launcher executable and run it
chmod +x start.sh
./start.sh You need: Operating System: Windows 10/11 (64-bit) or Linux (Debian/Ubuntu recommended).; Python: Version 3.10 required (Download). Python 3.10 is the only version with pre-built wheels for all dependencies (torch, torchvision, ONNX, ONNXRuntime). Python 3.11+ is not supported — key dependencies lack pre-built wheels, causing bu; Git: For cloning the repository (Download).
- Maintenance
- Active
- Last commit 5 months ago
- Stars
- 1,499
- +6 this week
- Licence
- MIT
- Allows business use
- Downloads for
- None listed
- No release files
- Latest version
- v2.0.0
- Released 6 months ago
- Built with
- Python
- 60% of the code
Is it looked after?
- Contributors
- 0
- Last 90 days
- Issues
- 61% closed
- 52 still open
- Pull requests
- 21 merged
- 11 waiting
- Releases
- 2
- 2 in the last year
- No contributing guide
- No security policy
- No code of conduct
Similar repos
| Repo | Stars | Last commit | Licence | Downloads for |
|---|---|---|---|---|
| debpalash / VoiceStudio | 105,349 | yesterday | AGPL-3.0 | Mac, Windows, Linux |
| Aratako / MioTTS-Inference | 208 | 5 days ago | MIT | No downloads |
| RVC-Boss / GPT-SoVITS | 64,596 | 9 days ago | MIT | No downloads |
More: languages, topics and project record
Languages
- Python 60%
- JavaScript 17%
- HTML 9%
- CSS 8%
Topics
- ai
- api-server
- audio-generation
- chatterbox
- chatterbox-tts
- cuda
- fastapi
- huggingface
- openai-api
- python
- pytorch
- rocm
Project record
- JobSpeech and audio
- StatusListed
- Commits182
- Forks365
- Watching10
- Stars in 28 days+37
- CreatedMay 31, 2025
- First seen by usNov 7, 2026
- CheckedNov 7, 2026