Turn APIs into LLM tools - AI tools

OpenTools provides a unified API enabling developers to connect Large Language Models (LLMs) with a diverse ecosystem of tools, simplifying integration and management.

• Usage Based

Monoid is an open-source platform that transforms APIs into AI Agents, enabling LLMs to gain context and perform real-time actions through a seamless and customizable interface.

• Free Trial

Astra Platform is a universal API designed to enhance Large Language Models (LLMs) with function calling capabilities, enabling seamless integration with over 2,200 applications.

• Contact for Pricing

Interlify seamlessly connects your existing APIs to Large Language Models (LLMs), enabling rapid integration and development of AI-powered features without complex coding.

• Freemium
• From 25$

Gorilla is an open-source Large Language Model (LLM) developed by UC Berkeley, designed to interact with a wide range of services by invoking API calls.

• Free

LLM API provides seamless access to over 200 leading AI models from top providers like OpenAI, Anthropic, Google, and Meta through a single, reliable API, empowering businesses and developers with infinite scalability.

• Usage Based

LiteLLM is a comprehensive LLM gateway solution that provides unified API management, authentication, load balancing, and spend tracking across multiple LLM providers including Azure OpenAI, Vertex AI, Bedrock, and OpenAI.

• Freemium

Candle is an SDK that provides programmatic read and write access to consumer internet services, enabling seamless integration with LLMs.

• Freemium
• From 84$

MCP Fabric seamlessly turns RESTful APIs into fully hosted, AI-ready MCP servers, enabling quick integration with Large Language Models (LLMs) without complex coding. Streamline API-to-AI connectivity, add context, and leverage advanced telemetry for powerful AI workflows.

• Free Trial
• From 10$

LlamaEdge is a lightweight and fast local LLM runtime and API server, powered by Rust & WasmEdge, designed for creating cross-platform LLM agents and web services.

• Free

Unify provides tools to build, test, and optimize LLM pipelines with custom interfaces and a unified API for accessing all models across providers.

• Freemium
• From 40$

LiteLLM provides a simplified and standardized way to interact with over 100 large language models (LLMs) using a consistent OpenAI-compatible input/output format.

• Free

BenchLLM is a tool for evaluating LLM-powered applications. It allows users to build test suites, generate quality reports, and choose between automated, interactive, or custom evaluation strategies.

• Other

Keywords AI is a comprehensive developer platform for LLM applications, offering monitoring, debugging, and deployment tools. It serves as a Datadog-like solution specifically designed for LLM applications.

• Freemium
• From 7$

Missing Studio is an open-source AI platform designed for developers to build and deploy generative AI applications. It offers tools for managing LLMs, optimizing performance, and ensuring reliability.

• Free

Laminar is an open-source platform that enables developers to trace, evaluate, label, and analyze Large Language Model (LLM) applications with minimal code integration.

• Freemium
• From 25$

WebLLM enables running large language models (LLMs) directly within a web browser using WebGPU for hardware acceleration, reducing server costs and enhancing privacy.

• Free

Open Source AI Gateway provides developers with a robust, production-ready solution to manage multiple LLM providers like OpenAI, Anthropic, and Gemini. It offers features like smart failover, caching, rate limiting, and monitoring for enhanced reliability and cost savings.

• Free

Flowise is an open-source low-code platform that enables developers to build customized LLM orchestration flows and AI agents through a drag-and-drop interface.

• Freemium
• From 35$

SillyTavern is a user interface you can install on your computer or Android phone that allows you to interact with LLMs backends and APIs, simulating characters for various purposes.

• Free

Mistral AI is a research lab developing state-of-the-art open-source and commercial Large Language Models (LLMs) for developers and enterprises.

• Other

liblab empowers developers to instantly generate custom SDKs, streamlined documentation, and AI-driven interfaces for APIs, enhancing efficiency and user experience.

• Usage Based
• From 5$

AiPy is an open-source, task-oriented AI assistant that uses Large Language Models (LLMs) to understand user requests, generate Python code, and execute it locally to automate tasks and deliver results.

• Free

Lora provides an SDK for integrating a fine-tuned, mobile-optimized local Large Language Model (LLM) into applications with minimal setup, offering GPT-4o-mini level performance.

• Freemium

2markdown is an API service that transforms websites and PDF documents into clean, structured markdown optimized for Large Language Models (LLMs). It streamlines content processing for AI applications.

• Freemium

WebCrawler API provides a developer-focused API for streamlined web crawling and data scraping, delivering website content in various formats suitable for training LLM AI models.

• Usage Based

Kalavai offers a platform for deploying Large Language Models (LLMs) across various devices, scaling from personal laptops to full production environments. It simplifies LLM deployment and experimentation.

• Paid
• From 29$

Andes is a comprehensive marketplace platform that connects developers with Large Language Model (LLM) APIs, enabling seamless integration of AI capabilities into applications.

• Contact for Pricing

LMQL is a programming language designed for large language models, offering robust and modular prompting with types, templates, and constraints.

• Free

Avian API is an enterprise-grade language model inference platform offering state-of-the-art LLMs with superior speed and competitive pricing, powered by Meta's Llama models and Nvidia H200 SXM technology.

• Usage Based
• From 3$