Agent skill

testing-e2e

End-to-end testing patterns with Playwright — page objects, AI agent testing, visual regression, accessibility testing with axe-core, and CI integration. Use when writing E2E tests, setting up Playwright, implementing visual regression, or testing accessibility.

Stars 143
Forks 15

Install this agent skill to your Project

npx add-skill https://github.com/yonatangross/orchestkit/tree/main/plugins/ork/skills/testing-e2e

Metadata

Additional technical details for this skill

category
document-asset-creation

SKILL.md

E2E Testing Patterns

End-to-end testing with Playwright 1.58+, visual regression, accessibility, and AI agent workflows.

Quick Reference

Category Rules Impact When to Use
emulate Backends rules/emulate-e2e.md HIGH FIRST CHOICE — deterministic API backends for E2E
Playwright Core rules/e2e-playwright.md HIGH Semantic locators, auto-wait, flaky detection
Page Objects rules/e2e-page-objects.md HIGH Encapsulate page interactions, visual regression
AI Agents rules/e2e-ai-agents.md HIGH Planner/Generator/Healer, init-agents
A11y Playwright rules/a11y-playwright.md MEDIUM Full-page axe-core scanning with WCAG 2.2 AA
A11y CI/CD rules/a11y-testing.md MEDIUM CI gates, jest-axe unit tests, PR blocking
End-to-End Types rules/validation-end-to-end.md HIGH tRPC, Prisma, Pydantic type safety

Total: 7 rules, 4 references, 3 checklists, 3 examples, 1 script

emulate Backends

For E2E tests that interact with external APIs (GitHub, Vercel, Google), use emulate as the backend instead of hitting real APIs. This eliminates flakiness from rate limits, network issues, and non-deterministic data.

Approach Result
emulate backends (FIRST CHOICE) Deterministic, fast, CI-friendly
Real APIs Flaky, rate-limited, slow
MSW/Nock intercepts No state machines, manual response management

Key features: seed config for reproducible data, per-worker port isolation for parallel Playwright, full state machine transitions.

See rules/emulate-e2e.md for patterns, CI configuration, and per-worker isolation fixtures.


Playwright Quick Start

typescript
import { test, expect } from '@playwright/test';

test('user can complete checkout', async ({ page }) => {
  await page.goto('/products');
  await page.getByRole('button', { name: 'Add to cart' }).click();
  await page.getByRole('link', { name: 'Checkout' }).click();
  await page.getByLabel('Email').fill('test@example.com');
  await page.getByRole('button', { name: 'Submit' }).click();
  await expect(page.getByRole('heading', { name: 'Order confirmed' })).toBeVisible();
});

Locator Priority: getByRole() > getByLabel() > getByPlaceholder() > getByTestId()

Playwright Core

Semantic locator patterns and best practices for resilient tests.

Rule File Key Pattern
Playwright E2E rules/e2e-playwright.md Semantic locators, auto-wait, new 1.58+ features

Anti-patterns (FORBIDDEN):

  • Hardcoded waits: await page.waitForTimeout(2000)
  • CSS selectors for interactions: await page.click('.submit-btn')
  • XPath locators

Page Objects

Encapsulate page interactions into reusable classes.

Rule File Key Pattern
Page Object Model rules/e2e-page-objects.md Locators in constructor, action methods, assertion methods
typescript
const checkout = new CheckoutPage(page);
await checkout.fillEmail('test@example.com');
await checkout.submit();
await checkout.expectConfirmation();

AI Agents

Playwright 1.58+ AI agent framework for test planning, generation, and self-healing. Includes a token-efficient CLI mode designed for coding agents — minimal output, structured responses, reduced context overhead.

Rule File Key Pattern
AI Agents rules/e2e-ai-agents.md Planner, Generator, Healer workflow
bash
npx playwright init-agents --loop=claude    # For Claude Code

Token-efficient CLI mode (1.58+): Playwright ships a SKILL-focused CLI mode that produces compact, agent-friendly output — use this when running Playwright from AI agents to minimize token consumption.

Workflow: Planner (explores app, creates specs) -> Generator (reads spec, tests live app) -> Healer (fixes failures, updates selectors).

Accessibility (Playwright)

Full-page accessibility validation with axe-core in E2E tests.

Rule File Key Pattern
Playwright + axe rules/a11y-playwright.md WCAG 2.2 AA, interactive state testing
typescript
import AxeBuilder from '@axe-core/playwright';

test('page meets WCAG 2.2 AA', async ({ page }) => {
  await page.goto('/');
  const results = await new AxeBuilder({ page })
    .withTags(['wcag2a', 'wcag2aa', 'wcag22aa'])
    .analyze();
  expect(results.violations).toEqual([]);
});

Accessibility (CI/CD)

CI pipeline integration and jest-axe unit-level component testing.

Rule File Key Pattern
CI Gates + jest-axe rules/a11y-testing.md PR blocking, component state testing

End-to-End Types

Type safety across API layers to eliminate runtime type errors.

Rule File Key Pattern
Type Safety rules/validation-end-to-end.md tRPC, Zod, Pydantic, schema rejection tests

Visual Regression

Native Playwright screenshot comparison without external services.

typescript
await expect(page).toHaveScreenshot('checkout-page.png', {
  maxDiffPixels: 100,
  mask: [page.locator('.dynamic-content')],
});

See references/visual-regression.md for full configuration, CI/CD workflows, cross-platform handling, and Percy migration guide.

Key Decisions

Decision Recommendation
E2E framework Playwright 1.58+ with semantic locators
Locator strategy getByRole > getByLabel > getByTestId
Browser Chromium (Chrome for Testing in 1.58+)
Page pattern Page Object Model for complex pages
Visual regression Playwright native toHaveScreenshot()
A11y testing axe-core (E2E) + jest-axe (unit)
CI retries 2-3 in CI, 0 locally
Flaky detection failOnFlakyTests: true in CI
AI agents Planner/Generator/Healer via init-agents
Type safety tRPC for end-to-end, Zod for runtime validation

References

Resource Description
references/playwright-1.57-api.md Playwright 1.58+ API: locators, assertions, AI agents, auth, flaky detection
references/playwright-setup.md Installation, MCP server, seed tests, agent initialization
references/visual-regression.md Screenshot config, CI/CD workflows, cross-platform, Percy migration
references/a11y-testing-tools.md jest-axe setup, Playwright axe-core, CI pipelines, manual checklists

Checklists

Checklist Description
checklists/e2e-checklist.md Locator strategy, page objects, CI/CD, visual regression
checklists/e2e-testing-checklist.md Comprehensive: planning, implementation, SSE, responsive, maintenance
checklists/a11y-testing-checklist.md Automated + manual: keyboard, screen reader, color contrast, WCAG

Examples

Example Description
examples/e2e-test-patterns.md User flows, page objects, auth fixtures, API mocking, multi-tab, file upload
examples/a11y-testing-examples.md jest-axe components, Playwright axe E2E, custom rules, CI pipeline
examples/orchestkit-e2e-tests.md OrchestKit analysis flow: page objects, SSE progress, error handling

Scripts

Script Description
scripts/create-page-object.md Generate Playwright page object with auto-detected patterns

Related Skills

  • testing-unit - Unit testing patterns with mocking, fixtures, and data factories
  • test-standards-enforcer - AAA and naming enforcement
  • run-tests - Test execution orchestration
  • emulate-seed - Seed configuration authoring for emulate providers
  • portless (upstream) - Stable baseURL for local E2E tests (myapp.localhost:1355 instead of port guessing)

Expand your agent's capabilities with these related and highly-rated skills.

yonatangross/orchestkit

expect

Diff-aware AI browser testing — analyzes git changes, generates targeted test plans, and executes them via agent-browser. Reads git diff to determine what changed, maps changes to affected pages via route map, generates a test plan scoped to the diff, and runs it with pass/fail reporting. Use when testing UI changes, verifying PRs before merge, running regression checks on changed components, or validating that recent code changes don't break the user-facing experience.

143 15
Explore
yonatangross/orchestkit

github-operations

GitHub CLI operations for issues, PRs, milestones, and Projects v2. Covers gh commands, REST API patterns, and automation scripts. Use when managing GitHub issues, PRs, milestones, or Projects with gh.

143 15
Explore
yonatangross/orchestkit

chain-patterns

Chain patterns for CC 2.1.71 pipelines — MCP detection, handoff files, checkpoint-resume, worktree agents, CronCreate monitoring. Use when building multi-phase pipeline skills. Loaded via skills: field by pipeline skills (fix-issue, implement, brainstorm, verify). Not user-invocable.

143 15
Explore
yonatangross/orchestkit

storybook-mcp-integration

Storybook MCP server integration for component-aware AI development. Covers 6 tools across 3 toolsets (dev, docs, testing): component discovery via list-all-documentation/get-documentation, story previews via preview-stories, and automated testing via run-story-tests. Use when generating components that should reuse existing Storybook components, running component tests via MCP, or previewing stories in chat.

143 15
Explore
yonatangross/orchestkit

component-search

Search 21st.dev component registry for production-ready React components. Finds components by natural language description, filters by framework and style system, returns ranked results with install instructions. Use when looking for UI components, finding alternatives to existing components, or sourcing design system building blocks.

143 15
Explore
yonatangross/orchestkit

ai-ui-generation

AI-assisted UI generation patterns for json-render, v0, Bolt, and Cursor workflows. Covers prompt engineering for component generation, review checklists for AI-generated code, design token injection, refactoring for design system conformance, and CI gates for quality assurance. Use when generating UI components with AI tools, rendering multi-surface MCP visual output, reviewing AI-generated code, or integrating AI output into design systems.

143 15
Explore

Didn't find tool you were looking for?

Be as detailed as possible for better results