samestrin / llm-interface
A simple NPM interface for seamlessly interacting with 36 Large Language Model (LLM) providers, including OpenAI, Anthropic, Google Gemini, Cohere, Hugging Face Inference, NVIDIA AI, Mistral AI, AI21 Studio, LLaMA.CPP, and Ollama, and hundreds of models.
Why this job: says: llama.cpp; topics: llamacpp
What it does
- Unified Interface. LLMInterface.sendMessage is a single, consistent interface to interact with 36 different LLM APIs (34 hosted LLM providers and 2 local LLM providers).
- Chat Completion, Streaming and Embeddings. Supports chat completion, streaming, and embeddings (with failover).
- Dynamic Module Loading. Automatically loads and manages LLM interfaces only when they are invoked, minimizing resource usage.
- Error Handling. Robust error handling mechanisms to ensure reliable API interactions.
- Extensible. Easily extendable to support additional LLM providers as needed.
Get started
npm install llm-interface- Maintenance
- Active
- Last commit yesterday
- Stars
- 123
- On GitHub
- Licence
- MIT
- Allows business use
- Downloads for
- None listed
- No release files
- Latest version
- v2.0.14
- Released 2 years ago
- Built with
- JavaScript
- 100% of the code
Is it looked after?
- Contributors
- 1
- Last 90 days
- Issues
- 0% closed
- 2 still open
- Pull requests
- 10 merged
- 0 waiting
- Releases
- 13
- 0 in the last year
- No contributing guide
- No security policy
- No code of conduct
Similar repos
| Repo | Stars | Last commit | Licence | Downloads for |
|---|---|---|---|---|
| devoxx / DevoxxGenieIDEAPlugin | 689 | yesterday | MIT | No downloads |
More: languages, topics, project record and preview image
Languages
- JavaScript 100%
Topics
- ai
- anthropic
- chatgpt
- claude
- gemini
- groq
- llamacpp
- llm
- openai
- reka
- cohere
- mistral
Project record
- JobLocal LLMs
- StatusListed
- Commits574
- Forks13
- Watching4
- Stars in 28 days0
- CreatedJun 12, 2024
- First seen by usNov 7, 2026
- CheckedNov 9, 2026