AI model debugging tools - AI tools

Arize is a comprehensive platform designed to accelerate the development and improve the production of AI applications and agents.

• Freemium
• From 50$

Decipher AI uses advanced vision LMs to analyze session replays, identifying customer issues, understanding feature usage, and providing actionable insights.

• Free Trial

AgentOps is a comprehensive developer platform that enables testing, debugging, and deployment of AI agents with support for 400+ LLMs, Crews, and AI agent frameworks.

• Freemium
• From 40$

AppMap enhances AI development tools by providing real-time runtime context of application behavior. It captures code execution, data flow, and performance, enabling smarter suggestions, faster debugging, and fewer defects.

• Freemium
• From 15$

Midscene.js is an AI-powered operator designed for web and Android automation and testing. It enables users to interact, query, and assert using natural language commands, simplifying script creation and maintenance.

• Free

Okareo provides error discovery and evaluation tools for AI agents, enabling faster iteration, increased accuracy, and optimized performance through advanced monitoring and fine-tuning.

• Freemium
• From 199$

Braintrust provides an end-to-end platform for developing, evaluating, and monitoring Large Language Model (LLM) applications. It helps teams build robust AI products through iterative workflows and real-time analysis.

• Freemium
• From 249$

Helicone is an all-in-one platform for monitoring, debugging, and improving production-ready LLM applications. It provides tools for logging, evaluating, experimenting, and deploying AI applications.

• Freemium
• From 20$

LastMile AI empowers developers to seamlessly transition generative AI applications from prototype to production with a robust developer platform.

• Contact for Pricing
• API

Literal AI streamlines the development of LLM applications, offering tools for evaluation, prompt management, logging, monitoring, and more to build production-grade AI products.

• Freemium

Parea is a platform for testing, evaluating, and monitoring Large Language Model (LLM) applications, helping teams track experiments, collect human feedback, and deploy prompts confidently.

• Freemium
• From 150$

Relvy is an agentic AI debugging assistant designed to help teams identify the root cause of alerts and incidents more quickly, learning from user interactions and providing transparent reasoning.

• Free Trial
• From 19$

Evidently AI is a comprehensive AI observability platform that helps teams evaluate, test, and monitor LLM and ML models in production, offering data drift detection, quality assessment, and performance monitoring capabilities.

• Freemium
• From 50$

gptme is a terminal-based AI assistant that can execute code, manipulate files, browse the web, and use vision, serving as a powerful tool for developers and knowledge workers.

• Free

Phoenix accelerates AI development with powerful insights, allowing seamless evaluation, experimentation, and optimization of AI applications in real time.

• Freemium