ReddRadar
Agent skill
whylabs-monitor
WhyLabs integration skill for ML observability, profile logging, and anomaly detection.
Install this agent skill to your Project
npx add-skill https://github.com/majiayu000/claude-skill-registry/tree/main/skills/data/whylabs-monitor
SKILL.md
whylabs-monitor
Overview
WhyLabs integration skill for ML observability, data profile logging, and anomaly detection in production ML systems.
Capabilities
- Data profile generation (whylogs)
- Profile upload to WhyLabs platform
- Anomaly detection and alerts
- Segment analysis for data subsets
- Performance monitoring dashboards
- Integration with ML pipelines
- Historical profile comparison
- Custom constraint validation
Target Processes
- Model Performance Monitoring and Drift Detection
- ML System Observability and Incident Response
Tools and Libraries
- whylogs
- WhyLabs Platform
- pandas
Input Schema
{
"type": "object",
"required": ["action"],
"properties": {
"action": {
"type": "string",
"enum": ["profile", "upload", "compare", "validate", "alert-config"],
"description": "WhyLabs action to perform"
},
"profileConfig": {
"type": "object",
"properties": {
"dataPath": { "type": "string" },
"datasetId": { "type": "string" },
"segments": { "type": "array", "items": { "type": "string" } },
"timestamp": { "type": "string" }
}
},
"uploadConfig": {
"type": "object",
"properties": {
"orgId": { "type": "string" },
"modelId": { "type": "string" },
"profilePath": { "type": "string" }
}
},
"compareConfig": {
"type": "object",
"properties": {
"baselineProfile": { "type": "string" },
"targetProfile": { "type": "string" },
"metrics": { "type": "array", "items": { "type": "string" } }
}
},
"validationConfig": {
"type": "object",
"properties": {
"constraints": {
"type": "array",
"items": {
"type": "object",
"properties": {
"column": { "type": "string" },
"constraint": { "type": "string" },
"value": { "type": "number" }
}
}
}
}
}
}
}
Output Schema
{
"type": "object",
"required": ["status", "action"],
"properties": {
"status": {
"type": "string",
"enum": ["success", "error", "warning"]
},
"action": {
"type": "string"
},
"profilePath": {
"type": "string"
},
"uploadId": {
"type": "string"
},
"dashboardUrl": {
"type": "string"
},
"comparison": {
"type": "object",
"properties": {
"driftScore": { "type": "number" },
"driftedFeatures": { "type": "array", "items": { "type": "string" } },
"alerts": { "type": "array" }
}
},
"validation": {
"type": "object",
"properties": {
"passed": { "type": "boolean" },
"failures": { "type": "array" }
}
}
}
}
Usage Example
{
kind: 'skill',
title: 'Profile and upload production data',
skill: {
name: 'whylabs-monitor',
context: {
action: 'profile',
profileConfig: {
dataPath: 'data/production_batch.parquet',
datasetId: 'fraud-detection',
segments: ['region', 'customer_type'],
timestamp: '2024-01-15T00:00:00Z'
},
uploadConfig: {
orgId: 'org-123',
modelId: 'model-fraud-v2'
}
}
}
}
Recommended Agent Skills
Expand your agent's capabilities with these related and highly-rated skills.
majiayu000/claude-skill-registry
agent-ops-spec
Manage specification documents in .agent/specs/. Use when user provides requirements, acceptance criteria, or feature descriptions that need to be tracked and validated against implementation.
majiayu000/claude-skill-registry
agent-ops-state
Maintain .agent state files. Use at session start, after meaningful steps, and before concluding: read/update constitution/memory/focus/issues/baseline consistently.
majiayu000/claude-skill-registry
agent-ops-spec
Manage specification documents in .agent/specs/. Use when user provides requirements, acceptance criteria, or feature descriptions that need to be tracked and validated against implementation.
majiayu000/claude-skill-registry
agent-ops-testing
Test strategy, execution, and coverage analysis. Use when designing tests, running test suites, or analyzing test results beyond baseline checks.
majiayu000/claude-skill-registry
agent-ops-testing
Test strategy, execution, and coverage analysis. Use when designing tests, running test suites, or analyzing test results beyond baseline checks.
majiayu000/claude-skill-registry
agent-ops-state
Maintain .agent state files. Use at session start, after meaningful steps, and before concluding: read/update constitution/memory/focus/issues/baseline consistently.
Didn't find tool you were looking for?