toverainc / willow-inference-server
Open source, local, and self-hosted highly optimized language inference server supporting ASR/STT, TTS, and LLM across WebRTC, REST, and WS
Why this job: says: tts; topics: text-to-speech, speech-recognition, whisper, speech-to-text
What it does
Willow Inference Server (WIS) is a focused and highly optimized language inference server implementation. Our goal is to "automagically" enable performant, cost-effective self-hosting of released state of the art/best of breed models to enable speech and language tasks:
Get started
No single install command. Read the steps in the README (opens in new tab)
- Maintenance
- Inactive
- Last commit 9 months ago
- Stars
- 511
- On GitHub
- Licence
- Apache-2.0
- Allows business use
- Downloads for
- None listed
- No release files
- Latest version
- None yet
- No releases
- Built with
- Python
- 52% of the code
Is it looked after?
- Contributors
- Not stated
- Last 90 days
- Issues
- 57% closed
- 38 still open
- Pull requests
- 32 merged
- 3 waiting
- Releases
- None
- Never published
- No contributing guide
- No security policy
- No code of conduct
Similar repos
| Repo | Stars | Last commit | Licence | Downloads for |
|---|---|---|---|---|
| Neywa-Labs / mlx-audio | 8,251 | yesterday | MIT | No downloads |
| argmaxinc / argmax-oss-swift | 6,453 | 32 days ago | MIT | No downloads |
| abus-aikorea / voice-pro | 13,424 | 4 months ago | GPL-3.0 | No downloads |
More: languages, topics and project record
Languages
- Python 52%
- JavaScript 23%
- HTML 12%
- Shell 10%
Topics
- cuda
- deep-learning
- llama
- llm
- privacy
- speech-recognition
- speech-to-text
- text-to-speech
- vicuna
- webrtc
- whisper
- willow
Project record
- JobSpeech and audio
- StatusListed
- Commits535
- Forks60
- Watching16
- Stars in 28 days0
- CreatedFeb 3, 2023
- First seen by usNov 7, 2026
- CheckedNov 8, 2026