LLM development framework - AI tools

Rig Build Modular and Scalable LLM Applications in Rust
Rig is a Rust-based framework for building modular and scalable LLM applications. It offers a unified LLM interface, Rust-powered performance, and advanced AI workflow abstractions.
- Free
Laminar The AI engineering platform for LLM products
Laminar is an open-source platform that enables developers to trace, evaluate, label, and analyze Large Language Model (LLM) applications with minimal code integration.
- Freemium
- From 25$
BenchLLM The best way to evaluate LLM-powered apps
BenchLLM is a tool for evaluating LLM-powered applications. It allows users to build test suites, generate quality reports, and choose between automated, interactive, or custom evaluation strategies.
- Other
Hegel AI Developer Platform for Large Language Model (LLM) Applications
Hegel AI provides a developer platform for building, monitoring, and improving large language model (LLM) applications, featuring tools for experimentation, evaluation, and feedback integration.
- Contact for Pricing
LMQL A programming language for LLMs.
LMQL is a programming language designed for large language models, offering robust and modular prompting with types, templates, and constraints.
- Free
PromptMage A Python framework for simplified LLM-based application development
PromptMage is a Python framework that streamlines the development of complex, multi-step applications powered by Large Language Models (LLMs), offering version control, testing capabilities, and automated API generation.
- Other
Lora Integrate local LLM with one line of code.
Lora provides an SDK for integrating a fine-tuned, mobile-optimized local Large Language Model (LLM) into applications with minimal setup, offering GPT-4o-mini level performance.
- Freemium
LangChain Build and Deploy LLM-Powered Applications and Agents
LangChain is a comprehensive framework for developing and deploying applications powered by large language models (LLMs), enabling the creation of sophisticated AI agents, chatbots, and data analysis tools. It facilitates building context-aware and reasoning applications.
- Free
LM Studio Discover, download, and run local LLMs on your computer
LM Studio is a desktop application that allows users to run Large Language Models (LLMs) locally and offline, supporting various architectures including Llama, Mistral, Phi, Gemma, DeepSeek, and Qwen 2.5.
- Free
Flowise Build LLM Apps Easily - Open Source Low-Code Tool for LLM Orchestration
Flowise is an open-source low-code platform that enables developers to build customized LLM orchestration flows and AI agents through a drag-and-drop interface.
- Freemium
- From 35$
Literal AI Ship reliable LLM Products
Literal AI streamlines the development of LLM applications, offering tools for evaluation, prompt management, logging, monitoring, and more to build production-grade AI products.
- Freemium
PromptsLabs A Library of Prompts for Testing LLMs
PromptsLabs is a community-driven platform providing copy-paste prompts to test the performance of new LLMs. Explore and contribute to a growing collection of prompts.
- Free
Axolotl AI We make fine-tuning accessible, scalable, fun
Axolotl AI is a free, open-source tool designed to make fine-tuning Large Language Models (LLMs) faster, more accessible, and scalable across various AI models and platforms.
- Free
LlamaEdge The easiest, smallest and fastest local LLM runtime and API server.
LlamaEdge is a lightweight and fast local LLM runtime and API server, powered by Rust & WasmEdge, designed for creating cross-platform LLM agents and web services.
- Free
W&B Weave A Framework for Developing and Deploying LLM-Based Applications
Weights & Biases (W&B) Weave is a comprehensive framework designed for tracking, experimenting with, evaluating, deploying, and enhancing LLM-based applications.
- Other