ReddRadar
Agent skill
model-card-generator
Model documentation skill for generating model cards following Google's model card framework.
Install this agent skill to your Project
npx add-skill https://github.com/a5c-ai/babysitter/tree/main/library/specializations/data-science-ml/skills/model-card-generator
SKILL.md
model-card-generator
Overview
Model documentation skill for generating comprehensive model cards following Google's model card framework for ML model documentation.
Capabilities
- Model details documentation (architecture, training, etc.)
- Intended use specification
- Performance metrics documentation
- Ethical considerations section
- Caveats and limitations
- Quantitative analysis sections
- Version history tracking
- Multiple output formats (HTML, Markdown, JSON)
Target Processes
- Model Interpretability and Explainability Analysis
- Model Evaluation and Validation Framework
- ML Model Retraining Pipeline
Tools and Libraries
- Model Card Toolkit
- TensorFlow Model Analysis (optional)
- Jinja2 (templating)
Input Schema
{
"type": "object",
"required": ["modelDetails", "intendedUse"],
"properties": {
"modelDetails": {
"type": "object",
"properties": {
"name": { "type": "string" },
"version": { "type": "string" },
"type": { "type": "string" },
"architecture": { "type": "string" },
"trainingDate": { "type": "string" },
"framework": { "type": "string" },
"citations": { "type": "array", "items": { "type": "string" } },
"license": { "type": "string" }
}
},
"intendedUse": {
"type": "object",
"properties": {
"primaryUses": { "type": "array", "items": { "type": "string" } },
"primaryUsers": { "type": "array", "items": { "type": "string" } },
"outOfScopeUses": { "type": "array", "items": { "type": "string" } }
}
},
"factors": {
"type": "object",
"properties": {
"relevantFactors": { "type": "array", "items": { "type": "string" } },
"evaluationFactors": { "type": "array", "items": { "type": "string" } }
}
},
"metrics": {
"type": "object",
"properties": {
"performanceMetrics": { "type": "array" },
"decisionThresholds": { "type": "object" },
"variationApproaches": { "type": "array" }
}
},
"evaluationData": {
"type": "object",
"properties": {
"datasets": { "type": "array" },
"motivation": { "type": "string" },
"preprocessing": { "type": "string" }
}
},
"trainingData": {
"type": "object",
"properties": {
"datasets": { "type": "array" },
"motivation": { "type": "string" },
"preprocessing": { "type": "string" }
}
},
"ethicalConsiderations": {
"type": "array",
"items": {
"type": "object",
"properties": {
"name": { "type": "string" },
"mitigationStrategy": { "type": "string" }
}
}
},
"caveatsAndRecommendations": {
"type": "array",
"items": { "type": "string" }
},
"outputConfig": {
"type": "object",
"properties": {
"format": { "type": "string", "enum": ["html", "markdown", "json"] },
"outputPath": { "type": "string" }
}
}
}
}
Output Schema
{
"type": "object",
"required": ["status", "modelCardPath"],
"properties": {
"status": {
"type": "string",
"enum": ["success", "error"]
},
"modelCardPath": {
"type": "string"
},
"format": {
"type": "string"
},
"sections": {
"type": "array",
"items": { "type": "string" }
},
"warnings": {
"type": "array",
"items": { "type": "string" },
"description": "Warnings about missing recommended sections"
}
}
}
Usage Example
{
kind: 'skill',
title: 'Generate model card',
skill: {
name: 'model-card-generator',
context: {
modelDetails: {
name: 'Fraud Detection Model',
version: '2.0.0',
type: 'Binary Classification',
architecture: 'XGBoost',
trainingDate: '2024-01-15',
framework: 'scikit-learn',
license: 'Proprietary'
},
intendedUse: {
primaryUses: ['Transaction fraud detection'],
primaryUsers: ['Risk management team'],
outOfScopeUses: ['Credit scoring', 'Identity verification']
},
metrics: {
performanceMetrics: [
{ name: 'AUC-ROC', value: 0.95 },
{ name: 'Precision@0.5', value: 0.87 }
]
},
ethicalConsiderations: [
{ name: 'Demographic bias', mitigationStrategy: 'Regular fairness audits' }
],
outputConfig: {
format: 'markdown',
outputPath: 'docs/model_card.md'
}
}
}
}
Recommended Agent Skills
Expand your agent's capabilities with these related and highly-rated skills.
a5c-ai/babysitter
gsd-tools
Central utility skill for GSD operations. Provides config parsing, slug generation, timestamps, path operations, and orchestrates calls to other specialized skills. Acts as the unified entry point that the original gsd-tools.cjs provided via its lib/ modules (commands, config, core, init).
a5c-ai/babysitter
model-profile-resolution
Resolve model profile (quality/balanced/budget) at orchestration start and map agents to specific models. Enables cost/quality tradeoffs by selecting appropriate AI models for each agent role.
a5c-ai/babysitter
verification-suite
Plan structure validation, phase completeness checks, reference integrity verification, and artifact existence confirmation. Provides the structured verification layer ensuring GSD artifacts are well-formed and complete.
a5c-ai/babysitter
state-management
STATE.md reading, writing, and field-level updates. Provides cross-session state persistence via .planning/STATE.md with structured fields for current task, completed phases, blockers, decisions, and quick tasks.
a5c-ai/babysitter
git-integration
Git commit patterns, formats, and conventions for GSD methodology. Provides atomic commits per task, structured commit messages, planning file commits, branch management, and milestone tag operations.
a5c-ai/babysitter
frontmatter-parsing
YAML frontmatter parsing and manipulation for .planning/ documents. Provides read, write, update, query, and validation operations on frontmatter blocks in GSD markdown artifacts.
Didn't find tool you were looking for?