LLM security testing platform - AI tools

promptfoo is an open-source LLM testing tool designed to help developers secure and evaluate their language model applications, offering features like vulnerability scanning and continuous monitoring.

• Freemium

Langtail is a comprehensive testing platform that enables teams to test and debug LLM-powered applications with a spreadsheet-like interface, offering security features and integration with major LLM providers.

• Freemium
• From 99$

Rhesis AI offers an open-source SDK to generate comprehensive, context-specific test sets for LLM applications, enhancing AI evaluation, reliability, and compliance.

• Freemium

BenchLLM is a tool for evaluating LLM-powered applications. It allows users to build test suites, generate quality reports, and choose between automated, interactive, or custom evaluation strategies.

• Other

NeuralTrust offers a unified platform for securing, testing, monitoring, and scaling Large Language Model (LLM) applications, ensuring robust security, regulatory compliance, and operational control for enterprises.

• Contact for Pricing

Autoblocks is a collaborative testing and evaluation platform for LLM-based products that automatically improves through user and expert feedback, offering comprehensive tools for monitoring, debugging, and quality assurance.

• Freemium
• From 1750$

Lemony is a secure, on-premise generative AI solution offering organization-wide trust, ownership, and transparency. It enables private, intelligent systems tailored for team collaboration and professional use.

• Paid
• From 499$

RoostGPT is an AI-powered testing co-pilot that automates test case generation, providing 100% test coverage while detecting static vulnerabilities. It leverages Large Language Models to enhance software development efficiency and reliability.

• Paid
• From 25000$

Pentra is a platform that streamlines penetration testing by automatically logging actions and generating reports using generative AI.

• Free

PromptsLabs is a community-driven platform providing copy-paste prompts to test the performance of new LLMs. Explore and contribute to a growing collection of prompts.

• Free

LLMMM helps brands track their presence in leading AI models like ChatGPT, Gemini, and Meta AI, providing real-time monitoring and brand safety insights.

• Free

Laminar is an open-source platform that enables developers to trace, evaluate, label, and analyze Large Language Model (LLM) applications with minimal code integration.

• Freemium
• From 25$