Agent skill

crawl-to-markdown

Use when web.run fails to parse a webpage and you need raw Markdown via Crawl4AI.

Stars 163
Forks 31

Install this agent skill to your Project

npx add-skill https://github.com/majiayu000/claude-skill-registry/tree/main/skills/documents/crawl-to-markdown-andrewginns-skills-collection

SKILL.md

Use this skill only after the built-in web.run tool fails to return usable content for a page.

What this skill does

  • Crawls one or more URLs with Crawl4AI.
  • Returns raw Markdown for each URL.

How to run

This script uses uv inline metadata. If uv is available just run:

bash
uv run scripts/crawl_to_markdown.py https://example.com

Multiple URLs:

bash
uv run scripts/crawl_to_markdown.py https://example.com https://example.org

Or pipe a newline-delimited list:

bash
printf "https://example.com\nhttps://example.org\n" | uv run scripts/crawl_to_markdown.py

Output format

For each URL, the script prints a header and raw Markdown content:

URL: https://example.com
<raw markdown>
---

If a crawl fails, the output includes an error block for that URL.

Expand your agent's capabilities with these related and highly-rated skills.

Didn't find tool you were looking for?

Be as detailed as possible for better results