mamei16 / LLM_Web_search

What it does

This project gives local LLMs the ability to search the web, either by using native tool calls or by outputting a specific command. Once a tool call has been issued or a command has been found in the model output using a regular expression, a web search is executed, returning a number of result pages. Finally, an ensemble of a dense embedding model and Okapi BM25 (Or alternatively, SPLADE) is used to extract the relevant parts (if any) of each web page in the search results and the results are appended to the model's output.