promptfoo favicon

promptfoo
Test & secure your LLM apps with open-source LLM testing

What is promptfoo?

promptfoo is an open-source tool trusted by over 51,000 developers for testing and securing large language model (LLM) applications. It provides automated red teaming, vulnerability scanning, and continuous monitoring to detect security, legal, and brand risks. The tool dynamically adapts to your application, uncovering issues like PII leaks, insecure tool use, and harmful content.

Built for developers, promptfoo offers a command-line interface, live reloads, and caching, ensuring a seamless experience without cloud dependencies or logins. Its battle-tested open-source framework is supported by an active community, making it a reliable choice for teams serving millions of users.

Features

  • Automated Red Teaming: Dynamically adapts to detect security, legal, and brand risks.
  • Vulnerability Scanning: Identifies issues like PII leaks, insecure tool use, and harmful content.
  • Continuous Monitoring: Provides real-time alerts and automated evaluations for LLM security.
  • Developer-Friendly CLI: Command-line interface with live reloads and caching for seamless use.
  • Open-Source Framework: Supported by an active community and used by teams serving millions of users.

Use Cases

  • Securing LLM applications against vulnerabilities
  • Automated red teaming for detecting security risks
  • Continuous monitoring of LLM performance and compliance
  • Evaluating LLM outputs for harmful or insecure content
  • Testing LLM integrations for legal and brand risks

FAQs

  • What is included in the Community version?
    The Community version includes all core features for local testing, evaluation, and vulnerability scanning.
  • Who needs the Enterprise version?
    Larger teams and organizations that want to continuously monitor risk in development and production.
  • How does Enterprise pricing work?
    Enterprise pricing is customized based on your team's size and needs. Contact promptfoo for a personalized quote.
  • Can I upgrade from Community to Enterprise?
    Yes, you can easily upgrade to Enterprise at any time to access additional features and support.

Related Queries

Helpful for people in the following professions

promptfoo Uptime Monitor

Average Uptime

99.93%

Average Response Time

140.53 ms

Last 30 Days

Related Tools:

Blogs:

  • Chat with PDF AI Tools

    Chat with PDF AI Tools

    Easily interact with your PDF documents using our advanced AI-powered tool. Whether you're reading lengthy reports, research papers, contracts, or eBooks, our platform lets you chat directly with your PDF files, ask questions, extract insights, and get summaries in real-time.

  • Best AI tools for Lawyers

    Best AI tools for Lawyers

    streamline legal processes, enhance research capabilities, and improve overall efficiency in the legal profession.

  • Ghibli Art Generator AI tools

    Ghibli Art Generator AI tools

    List of the best AI tools to turn your photos into images that look like Studio Ghibli movies. Easy to use and fun for everyone.

Didn't find tool you were looking for?

Be as detailed as possible for better results