Agent skill

web-scraping

Extract structured data from web pages using CSS selectors and XPath

Stars 4
Forks 0

Install this agent skill to your Project

npx add-skill https://github.com/tatat/agents-playground/tree/main/skills/web-scraping

SKILL.md

Web Scraping

Extract structured data from web pages.

Capabilities

  • Fetch HTML content from URLs
  • Parse and extract specific elements (tables, lists, text)
  • Handle pagination
  • Output in JSON or CSV format

Supported Selectors

  • CSS selectors: .class, #id, tag
  • XPath expressions
  • Text patterns (regex)

Rate Limiting

Always respect robots.txt and implement delays between requests. Default delay: 1 second between requests.

Example

Scrape product names and prices from example.com/products
Output as JSON with fields: name, price, url

Didn't find tool you were looking for?

Be as detailed as possible for better results