promptfoo - Test & secure your LLM apps with open-source LLM testing

promptfoo Test & secure your LLM apps with open-source LLM testing

What is promptfoo?

promptfoo is an open-source tool trusted by over 51,000 developers for testing and securing large language model (LLM) applications. It provides automated red teaming, vulnerability scanning, and continuous monitoring to detect security, legal, and brand risks. The tool dynamically adapts to your application, uncovering issues like PII leaks, insecure tool use, and harmful content.

Built for developers, promptfoo offers a command-line interface, live reloads, and caching, ensuring a seamless experience without cloud dependencies or logins. Its battle-tested open-source framework is supported by an active community, making it a reliable choice for teams serving millions of users.

Features

Automated Red Teaming: Dynamically adapts to detect security, legal, and brand risks.
Vulnerability Scanning: Identifies issues like PII leaks, insecure tool use, and harmful content.
Continuous Monitoring: Provides real-time alerts and automated evaluations for LLM security.
Developer-Friendly CLI: Command-line interface with live reloads and caching for seamless use.
Open-Source Framework: Supported by an active community and used by teams serving millions of users.

Use Cases

Securing LLM applications against vulnerabilities
Automated red teaming for detecting security risks
Continuous monitoring of LLM performance and compliance
Evaluating LLM outputs for harmful or insecure content
Testing LLM integrations for legal and brand risks

FAQs

What is included in the Community version?

The Community version includes all core features for local testing, evaluation, and vulnerability scanning.
Who needs the Enterprise version?

Larger teams and organizations that want to continuously monitor risk in development and production.
How does Enterprise pricing work?

Enterprise pricing is customized based on your team's size and needs. Contact promptfoo for a personalized quote.
Can I upgrade from Community to Enterprise?

Yes, you can easily upgrade to Enterprise at any time to access additional features and support.