ReddRadar
Agent skill
crawl-to-markdown
Use when web.run fails to parse a webpage and you need raw Markdown via Crawl4AI.
Install this agent skill to your Project
npx add-skill https://github.com/andrewginns/skills-collection/tree/main/crawl-to-markdown
SKILL.md
Use this skill only after the built-in web.run tool fails to return usable content for a page.
What this skill does
- Crawls one or more URLs with Crawl4AI.
- Returns raw Markdown for each URL.
How to run
This script uses uv inline metadata. If uv is available just run:
uv run scripts/crawl_to_markdown.py https://example.com
Multiple URLs:
uv run scripts/crawl_to_markdown.py https://example.com https://example.org
Or pipe a newline-delimited list:
printf "https://example.com\nhttps://example.org\n" | uv run scripts/crawl_to_markdown.py
Troubleshooting
Crawl succeeds but output is blank
Some sites don't match the default --selector and can return empty/whitespace Markdown.
The script will retry without CSS selection automatically, but you can also force it explicitly:
uv run scripts/crawl_to_markdown.py --selector '' https://example.com
uv cache permission errors
If uv fails accessing its cache directory (e.g. ~/.cache/uv), either point it at a
writable cache directory:
uv --cache-dir .uv-cache run scripts/crawl_to_markdown.py https://example.com
Or avoid the cache entirely:
uv --no-cache run scripts/crawl_to_markdown.py https://example.com
Output format
For each URL, the script prints a header and raw Markdown content:
URL: https://example.com
<raw markdown>
---
If a crawl fails, the output includes an error block for that URL.
Recommended Agent Skills
Expand your agent's capabilities with these related and highly-rated skills.
andrewginns/skills-collection
ultrathink
Run deep plan-first analysis. Use when the user explicitly asks for ultrathink (for example, "plan this first with ultrathink").
andrewginns/skills-collection
codex-app-themer
Turn an image, a theme URL, or a loose aesthetic description into a valid portable Codex app theme string. Use this when someone wants a `codex-theme-v1:` import for Codex.app and needs the result clearly labeled as a dark or light theme.
andrewginns/skills-collection
youtube-transcript
Use when a YouTube video transcript is needed e.g. for summarisation or Q&A on the content.
andrewginns/skills-collection
tailscale-serve
Expose a local dev server (localhost port) as a tailnet-only HTTPS URL using `tailscale serve`, and show the resulting ts.net URL.
mattpocock/skills
obsidian-vault
Search, create, and manage notes in the Obsidian vault with wikilinks and index notes. Use when user wants to find, create, or organize notes in Obsidian.
mattpocock/skills
edit-article
Edit and improve articles by restructuring sections, improving clarity, and tightening prose. Use when user wants to edit, revise, or improve an article draft.
Didn't find tool you were looking for?