apocas / restai
RESTai is an AIaaS (AI as a Service) open-source platform. Supports many public and local LLM suported by Ollama/vLLM/etc. Precise embeddings usage, tuning, analytics etc. Built-in image/audio generation with dynamic loading generators. Live chat deployment. Built-in block based graphical language. Prompt versioning and much more...
Why this job: says: local llm; topics: ollama, llama
What it does
- Entity-aware retrieval. A custom postprocessor boosts retrieved chunks whose source documents mention entities found in the user's query, improving recall on questions that reference specific names
- Visual graph explorer. Interactive force-directed graph (vis-network) of all entities and their co-occurrence relationships. Click any node for source list, mention count, and related entities
- Entity browser. Searchable, type-filtered table of every entity in the project with mention counts and one-click rename / merge / delete
- Disambiguation. "Find Duplicates" surfaces near-identical entity pairs (Levenshtein-based) for one-click merging — fix "Acme", "Acme Corp", "ACME Inc." in seconds
- Natural language graph queries. Ask questions like "What did the document say about Acme Corp?" and get answers scoped to entity-matched sources, bypassing pure vector similarity
Get started
No single install command. Read the steps in the README (opens in new tab)
- Maintenance
- Active
- Last commit 2 months ago
- Stars
- 517
- +1 this week
- Licence
- Apache-2.0
- Allows business use
- Downloads for
- None listed
- No release files
- Latest version
- v6.4.1
- Released 3 months ago
- Built with
- Python
- 56% of the code
Is it looked after?
- Contributors
- 5
- Last 90 days
- Issues
- 89% closed
- 2 still open
- Pull requests
- 191 merged
- 42 waiting
- Releases
- 117
- 30+ in the last year
- No contributing guide
- Security policy (opens in new tab)
- No code of conduct
More: languages, topics and project record
Languages
- Python 56%
- JavaScript 42%
- PHP 1%
- HTML <1%
Topics
- embeddings
- llm
- openai
- python
- fastapi
- rag
- openaiapi
- stable-diffusion
- transformers
- ollama
- blocky
- langchain
Project record
- JobLocal LLMs
- StatusListed
- Commits1,815
- Forks113
- Watching9
- Stars in 28 days+3
- CreatedMay 18, 2023
- First seen by usNov 7, 2026
- CheckedNov 9, 2026