Agent skill
tool-quality-audit
Audit tool integrations for deterministic behavior, error contracts, and logging before agents depend on them. Use when adding or updating tools or MCP servers.
Install this agent skill to your Project
npx add-skill https://github.com/majiayu000/claude-skill-registry/tree/main/skills/data/tool-quality-audit
Metadata
Additional technical details for this skill
- tags
-
tools validation mcp
- owner
- audience
- tool-authors
- stability
- draft
- short description
- Tool contract checks and smoke tests
SKILL.md
Tool Quality Audit
Overview
Evaluate a tool’s reliability with a checklist and small smoke tests. Emphasize deterministic outputs, clear errors, and stable schemas.
Quick start
- Fill
templates/tool_audit.json. - Run smoke tests manually or via your harness.
- Record findings in
results.json.
Core Guidance
- Prefer deterministic checks before LLM-based grading.
- Verify error contracts (consistent codes/messages).
- Validate schemas are stable and documented.
- Record latency and failure modes.
Resources
references/tool-audit-checklist.md: Reliability and contract checklist.templates/tool_audit.json: Audit scaffold for a tool.
Validation
- Ensure audit file is filled and failures are actionable.
Recommended Agent Skills
Expand your agent's capabilities with these related and highly-rated skills.
agent-ops-spec
Manage specification documents in .agent/specs/. Use when user provides requirements, acceptance criteria, or feature descriptions that need to be tracked and validated against implementation.
agent-ops-state
Maintain .agent state files. Use at session start, after meaningful steps, and before concluding: read/update constitution/memory/focus/issues/baseline consistently.
agent-ops-spec
Manage specification documents in .agent/specs/. Use when user provides requirements, acceptance criteria, or feature descriptions that need to be tracked and validated against implementation.
agent-ops-testing
Test strategy, execution, and coverage analysis. Use when designing tests, running test suites, or analyzing test results beyond baseline checks.
agent-ops-testing
Test strategy, execution, and coverage analysis. Use when designing tests, running test suites, or analyzing test results beyond baseline checks.
agent-ops-state
Maintain .agent state files. Use at session start, after meaningful steps, and before concluding: read/update constitution/memory/focus/issues/baseline consistently.
Didn't find tool you were looking for?