Find the Perfect AI Tools For Your Needs

Laminar is an open-source platform that enables developers to trace, evaluate, label, and analyze Large Language Model (LLM) applications with minimal code integration.

• Freemium
• From $25

LMCache is an open-source Knowledge Delivery Network (KDN) designed to accelerate LLM applications, making them up to 8x faster and more cost-effective. It improves performance for AI chatbots and RAG queries through prompt caching and KV cache compression.

• Free

LLMLingua Series offers prompt compression techniques to accelerate Large Language Model (LLM) inference, reduce costs, and enhance performance, especially in long context scenarios.

• Other

LlamaEdge is a lightweight and fast local LLM runtime and API server, powered by Rust & WasmEdge, designed for creating cross-platform LLM agents and web services.

• Free

Lora provides an SDK for integrating a fine-tuned, mobile-optimized local Large Language Model (LLM) into applications with minimal setup, offering GPT-4o-mini level performance.

• Freemium

LMQL is a programming language designed for large language models, offering robust and modular prompting with types, templates, and constraints.

• Free

Gorilla is an open-source Large Language Model (LLM) developed by UC Berkeley, designed to interact with a wide range of services by invoking API calls.

• Free

LM Studio is a desktop application that allows users to run Large Language Models (LLMs) locally and offline, supporting various architectures including Llama, Mistral, Phi, Gemma, DeepSeek, and Qwen 2.5.

• Free

LMSYS Org is a leading organization dedicated to developing and evaluating large language models and systems, offering open-source tools and frameworks for AI research and implementation.

• Free

LuMina LG empowers creators to train custom LoRA models and generate AI-enhanced visuals from personal images, offering intuitive asset management, collaboration, and scalable pricing for creative professionals and teams.

• Freemium
• From $10

Mancer is a large language model inferencing service that provides access to unfiltered LLMs. Users can run any prompts they want without restrictions, offering a powerful alternative to sanitized AI models.

• Usage Based

LlamaHub is a repository providing data loaders, agent tools, and LlamaPacks to quickly build and customize Retrieval-Augmented Generation (RAG) applications using frameworks like LlamaIndex and LangChain.

• Free

LM Studio is a user-friendly desktop application that allows users to run various large language models (LLMs) locally and offline, including Llama 2, PN3, Falcon, Mistral, StarCoder, and GEMMA models from Hugging Face.

• Free

Lemony is a secure, on-premise generative AI solution offering organization-wide trust, ownership, and transparency. It enables private, intelligent systems tailored for team collaboration and professional use.

• Paid
• From $499

LM-Kit provides .NET developers with tools for AI agent customization, creation, and orchestration. It enables multimodal generative AI systems integration in C# and VB.NET applications.

• Paid
• From $1000

MIOSN helps users find the most suitable and cost-effective Large Language Model (LLM) for their specific tasks by analyzing and comparing different models.

• Free

LLM Explorer is a comprehensive platform for discovering, comparing, and accessing over 46,000 open-source Large Language Models (LLMs) and Small Language Models (SLMs).

• Free

Float16.cloud provides managed GPU infrastructure and LLM solutions for AI workloads. It offers services like serverless GPU computing and one-click LLM deployment, optimizing cost and performance.

• Usage Based

Lambda provides on-demand NVIDIA GPU instances and clusters for AI training and inference. It offers a range of services, including 1-Click Clusters, on-demand instances, and private clouds, designed for AI developers.

• Usage Based

WebLLM enables running large language models (LLMs) directly within a web browser using WebGPU for hardware acceleration, reducing server costs and enhancing privacy.

• Free

WasmEdge is a cloud-native WebAssembly runtime that enables fast, lightweight, and secure AI inference and LLM applications on the edge with native GPU support and OpenAI compatibility.

• Other

Parea is a platform for testing, evaluating, and monitoring Large Language Model (LLM) applications, helping teams track experiments, collect human feedback, and deploy prompts confidently.

• Freemium
• From $150

Mem0 is a self-improving memory layer for LLM applications, enabling personalized AI experiences that save costs and improve over time.

• Freemium
• From $249

MemU is an agent memory layer for LLM applications that enables autonomous, intelligent memory management for AI agents with higher accuracy, faster retrieval, and lower cost.

• Freemium
• From $249

Reflection AI offers Reflection 70B, an open-source large language model trained with Reflection-Tuning to detect and correct its own reasoning errors for enhanced accuracy.

• Free

Neural Magic offers enterprise inference server solutions to streamline AI model deployment, maximizing computational efficiency and reducing costs on both GPU and CPU infrastructure.

• Contact for Pricing

LLaMA Learning Platform is an educational resource hub offering curated tutorials and articles to help users master LLaMA large language model technologies, applications, and fine-tuning techniques.

• Free

Reflection 70B is a next-gen open-source LLM, powered by Llama 70B, that features groundbreaking self-correction capabilities, outperforming GPT-4 in various benchmarks.

• Freemium
• From $8

Cognee is an AI memory engine that enhances the accuracy of LLM applications and agents. It transforms raw data into structured knowledge, improving the reliability of responses from large language models.

• Freemium
• From $1970

Rig is a Rust-based framework for building modular and scalable LLM applications. It offers a unified LLM interface, Rust-powered performance, and advanced AI workflow abstractions.

• Free