withcatai / catai
Run AI ✨ assistant locally! with simple API for Node.js 🚀
Why this job: topics: llama-cpp, local-llm, gguf
What it does
- Auto detect programming language 🧑💻
- Click on user icon to show original message 💬
- Real time text streaming ⏱️
- Fast model downloads 🚀
Get started
npm install -g catai
catai install qwen3-4b-q4_k_m
catai up- Maintenance
- Inactive
- Last commit 12 months ago
- Stars
- 498
- On GitHub
- Licence
- MIT
- Allows business use
- Downloads for
- None listed
- No release files
- Latest version
- v3.3.0
- Released 12 months ago
- Built with
- TypeScript
- 87% of the code
Is it looked after?
- Contributors
- Not stated
- Last 90 days
- Issues
- 96% closed
- 2 still open
- Pull requests
- 25 merged
- 0 waiting
- Releases
- 28
- 3 in the last year
- Contributing guide (opens in new tab)
- No security policy
- No code of conduct
Similar repos
| Repo | Stars | Last commit | Licence | Downloads for |
|---|---|---|---|---|
| AlexsJones / llmfit | 38,931 | yesterday | MIT | Mac, Windows, Linux |
| AtomicBot-ai / atomic-agent | 3,607 | 3 days ago | MIT | Mac, Linux |
| sgaofen / humanizer-local-model | 886 | 24 days ago | Apache-2.0 | Mac, Windows |
More: languages, topics and project record
Languages
- TypeScript 87%
- Svelte 6%
- JavaScript 4%
- CSS 3%
Topics
- chatgpt
- ai
- dalai
- openai
- chatbot
- chatui
- llama-cpp
- ai-assistant
- vicuna
- vicuna-installation-guide
- wizardlm
- catai
Project record
- JobLocal LLMs
- StatusListed
- Commits190
- Forks40
- Watching10
- Stars in 28 days0
- CreatedMar 25, 2023
- First seen by usNov 7, 2026
- CheckedNov 8, 2026