recipe-quality-audit

Audit a single NVCA recipe's quality and produce a structured scorecard.

Security model

• This skill operates on local repository files only — no network access required.
• Source document downloads (Tier 2 checks) use ensureSourceDocx() which fetches from known template source URLs only.
• No credentials or API keys are needed.

Usage

Run the audit for a specific recipe:

Audit the recipe: nvca-certificate-of-incorporation

Or audit all recipes:

Audit all NVCA recipes and update the quality tracker

Checks

Tier 1: Structural (no source download needed)

Tier 2: Behavioral (requires source download)

Tier 3: Fill quality (requires fill run)

Output: Quality Scorecard

{
  "recipe_id": "nvca-voting-agreement",
  "maturity": "beta",
  "scores": { "structural": "6/7", "behavioral": "3/4", "fill": "0/4", "total": "9/15" },
  "checks": [
    { "id": "S1", "name": "File inventory", "passed": true, "details": "metadata.yaml, replacements.json, clean.json present" },
    { "id": "S7", "name": "Test fixture exists", "passed": false, "details": "No fixture matching integration-tests/fixtures/nvca-voting-agreement-*.json" }
  ],
  "field_coverage": { "metadata_fields": 14, "replacement_refs": 10, "uncovered": 4 },
  "recommendations": [
    "Add test fixture for fill testing (S7)",
    "Add replacement keys for 4 uncovered fields (S3)"
  ]
}

Maturity Tiers

• scaffold: metadata-only, can't fill
• beta: has replacements + clean, score < 11/15 OR no test fixture
• production: score >= 11/15 AND has test fixture AND has computed.json (if conditional sections exist in source)

Workflow

When running the audit:

1. Read content/recipes/QUALITY_TRACKER.md for current state
2. Run Tier 1 checks (always possible)
3. Run Tier 2 checks if source document is available (use ensureSourceDocx())
4. Run Tier 3 checks if a test fixture exists
5. Compute scorecard and maturity tier
6. Output the scorecard as JSON
7. Update the quality tracker if requested

Implementation Notes

• Use validateRecipeMetadata() from src/core/metadata.ts for S2
• Use ensureSourceDocx() from src/core/recipe/downloader.ts for B1-B4
• Use runRecipe() from src/core/recipe/index.ts for F1-F4
• Bracket pattern detection uses \[[_A-Z] prefix to avoid counting citations and legal references
• Zero-match keys come from PatchResult.zeroMatchKeys returned by the patcher
• Cross-reference zero-match keys with cleanConfig.removeRanges and cleanConfig.removeParagraphPatterns to suppress expected zero-matches