vLLM – Alternatives et Outils IA Similaires
vLLM est un moteur d'inférence et de service open-source à haut débit pour le déploiement efficace de modèles AI de grande taille et multimodaux sur GPU, CPU et autres matériels d'accélération.
- Ollama 20
Ollama is a local and cloud AI model platform for running open models on personal hardware or cloud infrastructure through a desktop app, CLI, API, and developer integrations. — couvre 64.7% (11/17) - LM Studio Free
LM Studio is a desktop AI platform for discovering, downloading, running, and developing with open-source language models locally on Windows, macOS, and Linux, with private offline inference and local APIs. — couvre 64.7% (11/17) - Jan Free
Jan is a free, open-source AI assistant that lets users run large language models locally and offline, connect to cloud AI providers, deploy autonomous agents, and expose local models through an OpenAI-compatible API. — couvre 47.1% (8/17) - AnythingLLM Free
AnythingLLM is an open-source private AI assistant platform for running local or cloud LLMs with document chat, RAG, AI agents, automation, and customizable knowledge workspaces. — couvre 35.3% (6/17) - Confident AI 200
Confident AI is an AI quality platform for evaluating, testing, monitoring, and red-teaming LLM applications, AI agents, RAG systems, and conversational AI in development and production. — couvre 29.4% (5/17) - Athina AI On Demand
Athina AI is a collaborative AI development platform that helps teams build, evaluate, monitor, and optimize production-grade LLM applications with automated evaluations, prompt management, and observability tools. — couvre 17.6% (3/17) - Msty AI 149
Msty is a privacy-first AI workspace for running local and online AI models, building knowledge-based workflows, using AI agents, creating media, and connecting tools through MCP. — couvre 17.6% (3/17)