Agent skill

paper-review-pipeline

Use when a mostly complete ML conference paper needs self-review, pre-submission QA, camera-ready checking, section-by-section critique, citation-risk inspection, or rebuttal/review-response drafting. Skip this for initial drafting and use `paperreview` only when the user explicitly wants external submission.

Stars 190
Forks 12

Install this agent skill to your Project

npx add-skill https://github.com/cnfjlhj/ai-collab-playbook/tree/main/skills/full/paper-review-pipeline

SKILL.md

Paper Review Pipeline (ML Top Conferences)

Run a two-view paper review for ML conference submissions:

  1. Section-by-section review (Abstract → Intro → Method → Experiments → …) with concrete edits.
  2. Prioritized issue list with P0/P1/P2 severity, grouped by category, including recommended fixes and verification notes.

This skill also supports rebuttal / review response: parse reviewer comments, classify, choose a strategy, and draft a professional point-by-point response.

Parity Guarantee (No-Omission)

This skill is a consolidation layer. It must not omit any distinctive workflow, constraints, or output formats from the legacy skills it replaces.

Use:

  • references/parity-matrix.md as the feature-parity contract and regression scenarios.
  • references/modules/ for full imported workflows and checklists.

Execution Modes

This skill supports two modes:

  • Default: targeted — run only the most relevant tracks based on the user request and inputs, but always produce the Final Synthesis.
  • Optional: full-parallel — run all tracks as independent outputs (acceptable redundancy), then produce the Final Synthesis.

Trigger full-parallel when the user says: “全量”, “并行”, “run all tracks”, “run every skill”, “逐个 skill 测试”, “full pipeline”.

Protocol + required report template:

  • references/full-parallel-protocol.md
  • references/report-template.md

Optional External Second Opinion (paperreview)

If the user provides a near-final or final PDF, complete the local review first and then explicitly ask whether they also want an external second opinion via paperreview.

  • Ask only when the input is clearly a near-final or final PDF.
  • Do not auto-submit to external services. Get explicit confirmation first.
  • If the user agrees, hand off to paperreview as a follow-up step; otherwise finish with the local pipeline result only.

When to Use

  • Pre-submission quality check (ICML/ICLR/NeurIPS/AAAI).
  • After a draft is “mostly done” but clarity/logic is shaky.
  • When you suspect citation problems (missing, inconsistent, unverified, or claim-to-citation mismatch).
  • Before sending to advisor/collaborators for feedback (to reduce “obvious issues”).
  • After receiving reviews: draft rebuttal and a revision plan.

When NOT to Use

  • If the user wants new research or new experiments invented: require the user to provide results/artifacts.
  • If the user asks for verbatim PDF-to-LaTeX copying or large-scale reformatting without source.
  • If the task is pure BibTeX generation from memory: do not do it; use verified metadata workflows.

Non-Negotiable Guardrails

  1. No hallucinated citations.
    • If a citation cannot be verified, mark it as [CITATION NEEDED] / placeholder and tell the user explicitly.
    • Do not fabricate authors/years/venues/DOIs.
  2. Do not change technical meaning.
    • When proposing edits, preserve claims and numbers unless the user provides corrected data.
  3. Preserve LaTeX semantics when editing source.
    • Do not break \\cite{}, \\ref{}, \\label{}, math environments, figures/tables, or bibliography hooks.
  4. Respect blind review constraints (if applicable).
    • Avoid identity-revealing self-citations, acknowledgments, or repo links unless the user confirms it is camera-ready.

Inputs (Ask for the Minimum Needed)

For pre-submission review

  • Paper source: LaTeX section text, or the relevant excerpts pasted in chat (preferred), and optionally the PDF for context.
  • Target venue + track (ICML/ICLR/NeurIPS/AAAI) and any required sections (e.g., limitations / broader impact / ethics).
  • One-sentence contribution (if the user has it). If not, infer and ask for confirmation.

For rebuttal / review response

  • Reviewer comments (verbatim text, ideally grouped by reviewer).
  • Rebuttal constraints: word/page limit, formatting (ICLR OpenReview vs PDF), and timeline.
  • What the user is willing to change: “clarify only” vs “add experiments” vs “major rewrite”.

Output Contract (Always Produce Both Views)

View A — Section-by-Section Review

For each section, output:

  • What works (1–3 bullets)
  • What’s missing / unclear (P0/P1/P2 tagged bullets)
  • Concrete fixes (rewrite suggestions or structural moves)

Use the checklists in:

  • references/section-review-checklist.md

View B — P0/P1/P2 Issue List (Prioritized)

Format each issue like:

  • Priority: P0 (blocking) / P1 (important) / P2 (nice-to-have)
  • Category: Narrative / Evidence / Experimental Design / Statistics / Reproducibility / Citations / Writing / Figures-Tables / Format
  • Where: section name + a short quote anchor (or LaTeX label if available)
  • Problem
  • Fix
  • Verification (if needed): what evidence/log/search is required before claiming it is correct

Use the taxonomy in:

  • references/p0-p2-taxonomy.md

Modules (Routing Rules)

Use these modules to preserve legacy feature parity:

  • Paper-level QA: references/modules/paper-self-review.md
  • Rebuttal / review response: references/modules/review-response.md and references/rebuttal-workflow.md
  • LaTeX + BibTeX toolbox: references/modules/academic-paper-helper.md
  • Claim-level citation audit: references/modules/citation-validator.md and references/citation-integrity.md
  • Anti-AI polish: references/modules/writing-anti-ai.md
  • LaTeX rhythm pass: references/modules/latex-rhythm-refiner.md
  • Literature discovery (extended): references/modules/claude-scholar-ml-paper-writing.md

Workflow (Default)

Pass 0 — Triage (5–10 minutes)

  1. Identify the one-sentence contribution and confirm it with the user.
  2. Extract the top 3–7 claims the paper relies on.
  3. For each claim, note the current support:
    • empirical result (table/figure)
    • theorem/proof
    • citation / prior work
    • ablation / analysis
  4. Flag immediate P0 risks (typical: missing baselines, unclear experimental protocol, unverified citations, paper “about X” but experiments test Y).

Pass 1 — Section Review (primary deliverable)

Review sections in order (and check alignment between them):

  1. Abstract
  2. Introduction (motivation → gap → contribution bullets)
  3. Related Work (positioning + not a bibliography dump)
  4. Method (reproducible description + design justification)
  5. Experiments / Results (fair baselines + full setup + statistical reporting)
  6. Analysis / Ablations (claim-driven, not exploratory noise)
  7. Limitations / Broader Impact / Ethics (venue-dependent)
  8. Conclusion (tight restatement + constraints + future work without overclaim)

Pass 2 — Consolidate into P0/P1/P2

Turn findings into an actionable issue list:

  • P0 first (blockers / likely desk-reject causes)
  • P1 next (acceptance probability movers)
  • P2 last (polish)

Pass 3 (Optional) — Revision Plan

If the user wants an execution plan, produce:

  • 3–8 tasks with measurable acceptance criteria
  • suggested order (dependency-aware)
  • what can be done in parallel (writing vs experiments vs citations)

Full-Parallel Workflow (Comprehensive)

When mode is full-parallel, do not collapse everything into one voice. Instead:

  1. Run all tracks (A–G) as independent “mini-reviewers” and keep each track output visible.
  2. Then produce the Final Synthesis:
    • View A: consolidated section-by-section review
    • View B: consolidated P0/P1/P2 issue list
    • minimal revision plan
    • conflicts & resolutions between tracks

Use:

  • references/full-parallel-protocol.md
  • references/report-template.md

Rebuttal / Review Response Module

When reviews arrive, do:

  1. Parse and classify each comment: Major / Minor / Clarification / Missing baseline / Missing experiment / Writing / Citation / Misunderstanding.
  2. Choose a strategy per item: Accept + change, Clarify, Defend, Add experiment, Defer (explain constraints).
  3. Draft point-by-point responses with:
    • gratitude + precise restatement
    • what changed (or why not)
    • where to find it (section/figure/table)
    • evidence-based tone (no overpromising)

Use:

  • references/rebuttal-workflow.md

Citation Integrity Module (Hard Requirement)

Before submission, ensure:

  • every non-trivial factual claim has a citation or empirical evidence
  • every citation key resolves in the bibliography
  • any newly added citations are verified (paper exists; BibTeX not fabricated)

If deep citation audit is requested, follow:

  • references/citation-integrity.md

Expand your agent's capabilities with these related and highly-rated skills.

cnfjlhj/ai-collab-playbook

paperreview

Use when the user explicitly wants to upload a final or near-final PDF to paperreview.ai for an external second opinion. Skip this for local paper critique, which should go through `paper-review-pipeline` first.

190 12
Explore
cnfjlhj/ai-collab-playbook

skill-governance-loop

Use when the user asks to review a skill, analyze skill quality, update a skill version, or run a repeatable keep/disable/archive decision loop from real failures instead of abstract best practices.

190 12
Explore
cnfjlhj/ai-collab-playbook

academic-paper-helper

学术论文写作助手,专门用于 LaTeX 论文编写、BibTeX 管理、格式化、学术写作规范检查。适用于 AI/ML 研究论文、会议投稿(NeurIPS、ICML、ICLR 等)

190 12
Explore
cnfjlhj/ai-collab-playbook

collaborating-with-claude

Use when you want Claude Code CLI as a second opinion for coding tasks such as design tradeoffs, debugging, or diff review, while keeping Codex as the primary implementer.

190 12
Explore
cnfjlhj/ai-collab-playbook

proactive-explorer

落实 CLAUDE.md / AGENTS.md 中的“主动探索”原则,在向用户提问前自动使用 Grep、Read、Bash、WebSearch 等工具获取信息

190 12
Explore
cnfjlhj/ai-collab-playbook

writing-anti-ai

This skill should be used when the user asks to "remove AI writing patterns", "humanize this text", "make this sound more natural", "remove AI-generated traces", "fix robotic writing", or needs to eliminate AI writing patterns from prose. Supports both English and Chinese text. Based on Wikipedia's "Signs of AI writing" guide, detects and fixes inflated symbolism, promotional language, superficial -ing analyses, vague attributions, AI vocabulary, negative parallelisms, and excessive conjunctive phrases.

190 12
Explore

Didn't find tool you were looking for?

Be as detailed as possible for better results