dezoito / ollama-grid-search

What it does

• Automatically fetches models from local or remote Ollama servers;
• Iterates over multiple different models, prompts and parameters to generate inferences;
• A/B test different prompts on several models simultaneously;
• Allows multiple iterations for each combination of parameters;
• Allows limited concurrency or synchronous inference calls (to prevent spamming servers);