LLM management platform - AI tools

Laminar is an open-source platform that enables developers to trace, evaluate, label, and analyze Large Language Model (LLM) applications with minimal code integration.

• Freemium
• From 25$

LiteLLM is a comprehensive LLM gateway solution that provides unified API management, authentication, load balancing, and spend tracking across multiple LLM providers including Azure OpenAI, Vertex AI, Bedrock, and OpenAI.

• Freemium

Lemony is a secure, on-premise generative AI solution offering organization-wide trust, ownership, and transparency. It enables private, intelligent systems tailored for team collaboration and professional use.

• Paid
• From 499$

Flowise is an open-source low-code platform that enables developers to build customized LLM orchestration flows and AI agents through a drag-and-drop interface.

• Freemium
• From 35$

Kalavai offers a platform for deploying Large Language Models (LLMs) across various devices, scaling from personal laptops to full production environments. It simplifies LLM deployment and experimentation.

• Paid
• From 29$

Literal AI streamlines the development of LLM applications, offering tools for evaluation, prompt management, logging, monitoring, and more to build production-grade AI products.

• Freemium

LiteLLM provides a simplified and standardized way to interact with over 100 large language models (LLMs) using a consistent OpenAI-compatible input/output format.

• Free

LM Studio is a user-friendly desktop application that allows users to run various large language models (LLMs) locally and offline, including Llama 2, PN3, Falcon, Mistral, StarCoder, and GEMMA models from Hugging Face.

• Free

Open Source AI Gateway provides developers with a robust, production-ready solution to manage multiple LLM providers like OpenAI, Anthropic, and Gemini. It offers features like smart failover, caching, rate limiting, and monitoring for enhanced reliability and cost savings.

• Free

LM Studio is a desktop application that allows users to run Large Language Models (LLMs) locally and offline, supporting various architectures including Llama, Mistral, Phi, Gemma, DeepSeek, and Qwen 2.5.

• Free