Agent skill
Teradata ROC Curve Analysis
ROC curve and AUC analysis for binary classification evaluation
Install this agent skill to your Project
npx add-skill https://github.com/teradata-labs/claude-cookbooks/tree/main/skills/analytics/td-roc
SKILL.md
Teradata ROC Curve Analysis
| Property | Value |
|---|---|
| Skill Name | Teradata ROC Curve Analysis |
| Description | ROC curve and AUC analysis for binary classification evaluation |
| Category | Model Evaluation |
| Primary Function | TD_ROC |
| Framework | SQLE |
Core Capabilities
- Automated table structure analysis via DBC.ColumnsV
- Dynamic SQL generation for TD_ROC
- Complete workflow from data preparation to results interpretation
- Data quality validation and preprocessing guidance
- Parameter optimization and tuning
Key Parameters
- ProbabilityColumn: Column with predicted probabilities
- ObservationColumn: Column with actual class labels
- PositiveClass: Value representing the positive class
- NumThresholds: Number of threshold points (default 50)
Use Cases
- Binary classifier performance evaluation
- Threshold selection optimization
- Model comparison via AUC
- Trade-off analysis between TPR and FPR
Example Usage
-- TD_ROC execution
SELECT * FROM TD_ROC (
ON {USER_DATABASE}.{PREDICTION_TABLE} AS InputTable
USING
ProbabilityColumn ('{PROBABILITY_COLUMN}')
ObservationColumn ('{ACTUAL_LABEL_COLUMN}')
PositiveClass ('{POSITIVE_CLASS_VALUE}')
NumThresholds (50)
) AS dt;
Scripts Included
Core Analytics Scripts
table_analysis.sql: Automatic table structure discoverypreprocessing.sql: Data preparation and feature engineeringmodel_training.sql: TD_ROC executionevaluation.sql: Results analysis and metricscomplete_workflow_template.sql: End-to-end workflow
Utility Scripts
data_quality_checks.sql: Comprehensive data validationparameter_tuning.sql: Parameter optimizationdiagnostic_queries.sql: Results diagnostics and interpretation
Best Practices
- Always run table_analysis.sql first to understand your data structure
- Validate data quality before executing the analytical function
- Use parameter_tuning.sql to find optimal configuration
- Review diagnostic_queries.sql output for model/results validation
Limitations
- Requires Teradata Vantage 17.20+ with ClearScape Analytics
- Input data must meet function-specific requirements
- Results depend on data quality and parameter configuration
Teradata ROC Curve Analysis - ClearScape Analytics skill for Teradata Vantage
Recommended Agent Skills
Expand your agent's capabilities with these related and highly-rated skills.
tune-workloads
Analyze workload classification and **autonomously configure** classification rules, filters, and priorities to improve accuracy and meet business requirements
optimize-throttles
Analyze throttle behavior, recommend optimal configurations, and autonomously create/modify throttles to balance resource allocation and meet performance SLAs
analyze-performance
Analyze system performance using throttle statistics, query logs, and resource metrics to identify bottlenecks and optimization opportunities
monitor-workloads
Monitor workload definitions, distribution, and TASM statistics using real-time resources to understand classification effectiveness and workload performance
monitor-resources
Monitor AMP processor load, system physical resources, and capacity using real-time resources to track system health and identify performance bottlenecks
monitor-sessions
Monitor active Teradata sessions using real-time resources, view SQL execution details, identify blocking issues, and optionally take control actions
Didn't find tool you were looking for?