LLM security testing platform - AI tools

Conviction is an AI platform designed for evaluating, testing, and monitoring Large Language Models (LLMs) to help developers build reliable AI applications faster. It focuses on detecting hallucinations, optimizing prompts, and ensuring security.

• Freemium
• From 249$

promptfoo is an open-source LLM testing tool designed to help developers secure and evaluate their language model applications, offering features like vulnerability scanning and continuous monitoring.

• Freemium

Langtail is a comprehensive testing platform that enables teams to test and debug LLM-powered applications with a spreadsheet-like interface, offering security features and integration with major LLM providers.

• Freemium
• From 99$

Rhesis AI offers an open-source SDK to generate comprehensive, context-specific test sets for LLM applications, enhancing AI evaluation, reliability, and compliance.

• Freemium

BenchLLM is a tool for evaluating LLM-powered applications. It allows users to build test suites, generate quality reports, and choose between automated, interactive, or custom evaluation strategies.

• Other

NeuralTrust offers a unified platform for securing, testing, monitoring, and scaling Large Language Model (LLM) applications, ensuring robust security, regulatory compliance, and operational control for enterprises.

• Contact for Pricing

Autoblocks is a collaborative testing and evaluation platform for LLM-based products that automatically improves through user and expert feedback, offering comprehensive tools for monitoring, debugging, and quality assurance.

• Freemium
• From 1750$

grimly.ai offers robust AI security, protecting Large Language Models (LLMs) from threats like jailbreaks, prompt injection, and semantic attacks in real-time. It provides multi-layer defense for AI integrations, ensuring operational safety and integrity.

• Paid
• From 59$

Lemony is a secure, on-premise generative AI solution offering organization-wide trust, ownership, and transparency. It enables private, intelligent systems tailored for team collaboration and professional use.

• Paid
• From 499$

Alumnium is an AI-powered tool that translates natural language test instructions into executable commands for browser test automation, integrating with Playwright and Selenium.

• Freemium

RoostGPT is an AI-powered testing co-pilot that automates test case generation, providing 100% test coverage while detecting static vulnerabilities. It leverages Large Language Models to enhance software development efficiency and reliability.

• Paid
• From 25000$

Pentra is a platform that streamlines penetration testing by automatically logging actions and generating reports using generative AI.

• Free

PromptsLabs is a community-driven platform providing copy-paste prompts to test the performance of new LLMs. Explore and contribute to a growing collection of prompts.

• Free

Almanax is an AI-powered security engineering copilot designed to detect complex vulnerabilities in codebases, scan dependencies, and filter false positives from security alerts, enhancing code security for development teams.

• Contact for Pricing

LLMMM helps brands track their presence in leading AI models like ChatGPT, Gemini, and Meta AI, providing real-time monitoring and brand safety insights.

• Free

Laminar is an open-source platform that enables developers to trace, evaluate, label, and analyze Large Language Model (LLM) applications with minimal code integration.

• Freemium
• From 25$