Evaluate AI model performance - AI tools

WhichModel is a next-generation AI benchmarking platform that helps users compare, optimize, and analyze AI models to make data-driven decisions for their applications.

• Usage Based

Future AGI is a comprehensive evaluation and optimization platform designed to help enterprises build, evaluate, and improve AI applications, aiming for high accuracy across software and hardware.

• Freemium
• From 50$

Intura helps businesses experiment with, compare, and deploy AI and LLM models side-by-side to optimize performance and cost before full-scale implementation.

• Freemium

Arize is a comprehensive platform designed to accelerate the development and improve the production of AI applications and agents.

• Freemium
• From 50$

Evidently AI is a comprehensive AI observability platform that helps teams evaluate, test, and monitor LLM and ML models in production, offering data drift detection, quality assessment, and performance monitoring capabilities.

• Freemium
• From 50$

Neutrino AI provides multi-model AI infrastructure to optimize Large Language Model (LLM) performance for applications. It offers tools for evaluation, intelligent routing, and observability to enhance quality, manage costs, and ensure scalability.

• Usage Based

Parea is a platform for testing, evaluating, and monitoring Large Language Model (LLM) applications, helping teams track experiments, collect human feedback, and deploy prompts confidently.

• Freemium
• From 150$

Weco utilizes an AI research engineer, AIDE, to automate code optimization and research through benchmark-driven experimentation, delivering measurable performance improvements.

• Contact for Pricing

BenchLLM is a tool for evaluating LLM-powered applications. It allows users to build test suites, generate quality reports, and choose between automated, interactive, or custom evaluation strategies.

• Other

EvalsOne is a platform for rapidly evaluating Large Language Models (LLMs) and Retrieval-Augmented Generation (RAG) pipelines using various metrics.

• Freemium
• From 19$

Freeplay provides comprehensive tools for AI teams to run experiments, evaluate model performance, and monitor production, streamlining the development process.

• Paid
• From 500$

Conviction is an AI platform designed for evaluating, testing, and monitoring Large Language Models (LLMs) to help developers build reliable AI applications faster. It focuses on detecting hallucinations, optimizing prompts, and ensuring security.

• Freemium
• From 249$

LastMile AI empowers developers to seamlessly transition generative AI applications from prototype to production with a robust developer platform.

• Contact for Pricing
• API

Adaline is a collaborative platform for teams building with Large Language Models (LLMs), enabling efficient iteration, evaluation, deployment, and monitoring of prompts.

• Contact for Pricing