AnythingLLM
AnythingLLM is an open-source private AI assistant platform for running local or cloud LLMs with document chat, RAG, AI agents, automation, and customizable knowledge workspaces.
AnythingLLM is an all-in-one AI application developed by Mintplex Labs for individuals, developers, teams, and organizations that want a customizable AI assistant with strong privacy and deployment flexibility. It combines conversational AI, retrieval-augmented generation, document knowledge bases, AI agents, vector databases, and automation without requiring users to build the underlying infrastructure themselves.
The desktop application runs on macOS, Windows, and Linux and can operate entirely on-device. Users can connect local language models, import documents into searchable knowledge bases, chat with their content, perform research, create agent workflows, and use supported tools without sending data to a cloud service when configured locally. AnythingLLM can also recommend models based on the user's hardware.
Its AI agents can use tools to complete multi-step tasks while custom agent skills extend their capabilities. AnythingLLM also supports web scraping and search, developer API access, embedded website chat widgets, multiple embedding models, configurable vector databases, and recurring Scheduled Jobs. Newer desktop productivity features include a local Meeting Assistant plus Magic Echo for intelligent dictation, Magic Beacon for AI actions on highlighted text, and Magic Tab for contextual autocomplete across desktop applications.
AnythingLLM Desktop is free and requires no account. Self-hosted Docker deployment is also available for multi-user environments with administration and workspace permissions. Managed AnythingLLM Cloud is optional: Basic costs $50 per month and Pro costs $99 per month while Enterprise uses custom pricing. Cloud instances are privately hosted on isolated infrastructure but require users to provide an LLM API key. An optional AnythingLLM Pro subscription removes daily limits from desktop Magic features although its current public documentation does not clearly publish the subscription price.