Mintplex-Labs / anything-llm

What it does

• Built-in local LLM engine. Run local models on your CPU or GPU (NVIDIA via CUDA, AMD and Intel via Vulkan) with no extra setup, powered by Lemonade and llama.cpp.
• Dynamic Model Routing. Automatically route chats to the best provider & model for the conversation based on rules you define.
• Automatic & User Managed Memories. Have your LLM remember important information about you or your workspace.
• Scheduled Tasks. Run recurring tasks or prompts on a cron schedule with full agent capabilities.
• Intelligent Skill Selection Enable unlimited tools for your models while reducing token usage by up to 80% per query