Libretto - LLM Monitoring, Testing, and Optimization

Libretto LLM Monitoring, Testing, and Optimization

Freemium

From 180$

Home: https://www.getlibretto.com

#LLM monitoring
#prompt-testing
#model optimization
#Drift Detection
#AI Performance
#Failure Detection

Visit Libretto

What is Libretto?

Libretto is a platform designed to provide robust monitoring, testing, and optimization solutions for Large Language Models (LLMs). It helps users quickly identify and address failures, automate prompt testing, and stay ahead of model drift.

The platform offers features such as toxicity, refusal, and jailbreak detection, along with prompt chain monitoring. Libretto enables the optimization of AI performance ensuring high-quality results and reliable operation.

Features

Monitoring: LLM Monitoring That Finds Failures, Fast
Testing: AI Prompt Testing, Automated
Optimization: Optimize Your AI
Drift Detection: Stay Ahead of Model Drift
Toxicity, Refusal, and Jailbreak detection: Detect potential issues in LLM outputs.
Prompt chain monitoring: Monitor the flow and performance of prompt chains.

Use Cases

Monitoring LLM performance to identify failures.
Automating AI prompt testing.
Optimizing AI model performance.
Detecting and mitigating model drift.
Detecting toxicity, refusal, and jailbreaks

FAQs

What is the free tier?

The free tier allows up to 5 prompt templates and 100 events per day. You can also utilize event outlier detection and LLM chain logging. However, it has limitations on active drift dashboards, test runs, and number of test cases.
How do I upgrade?

To upgrade to the custom tier, you need to schedule a meeting with our team. During this meeting, we will discuss your specific needs and tailor a plan that works for you. Upgrading will unlock additional features and capabilities.
Can I cancel anytime?

Yes, you can cancel your subscription at any time. Simply contact our support team to initiate the cancellation process. We strive to make this as easy as possible for you.
What payment methods accepted?

We accept various payment methods, including credit cards and PayPal. If you have specific requirements, feel free to reach out.