Welcome to AnyLLM

AnyLLM is a powerful, yet simple, command-line interface (CLI) tool that allows you to interact with various large language models (LLMs) directly from your terminal. It's designed to be provider-agnostic, meaning you can use models from Ollama, OpenAI, or any other provider with an OpenAI-compatible API.

Key Features

• Provider Agnostic: Configure and switch between different AI providers and models on the fly. Whether you're using a local model with Ollama or a powerful cloud-based model, AnyLLM has you covered.

• Interactive TUI: A user-friendly terminal user interface (TUI) allows you to easily select the provider and model you want to use. It also provides a rich input experience with autocomplete for file paths.

• File System Integration: AnyLLM is not just a chatbot. It's a coding assistant with tools to interact with your file system. The AI can:

  • List files in your project.
  • Read file contents to understand your code.
  • Create and edit files, allowing it to write new code or modify existing files.
  • Search your codebase to find relevant information.

• Safety First: When the AI suggests changes to your files, AnyLLM displays a clear diff of the proposed modifications, so you always have the final say before any changes are applied.

How It Works

AnyLLM works by sending your prompts, along with a system prompt containing the context of your current working directory and the available tools, to the selected LLM. The AI can then use the special tool syntax in its response to perform actions on your file system. This cycle of prompt, response, and tool execution allows for a powerful and interactive coding experience.