Agent skill
web-fetch
Fetch and extract clean content from URLs using Jina Reader API. Use when users need to read webpage content, extract article text, or fetch URL content for analysis. Triggers on "fetch this page", "read this URL", "extract content from", "get the content of", "what does this page say".
Install this agent skill to your Project
npx add-skill https://github.com/vaayne/agent-kit/tree/main/skills/web-fetch
SKILL.md
Web Fetch
Overview
Extract clean, readable content from any URL using Jina Reader API. Returns raw JSON with title, content, and metadata optimized for LLM consumption.
When to Use
- User wants to read or analyze webpage content
- Need to extract article text from a URL
- Fetching documentation or reference pages
- Converting web pages to clean text for processing
Workflow
- Identify the URL from user request
- Validate URL format
- Run the fetch script
- Present extracted content to user
Usage
# Basic fetch
uv run --script scripts/web_fetch.py --url "https://example.com"
# With custom timeout
uv run --script scripts/web_fetch.py \
--url "https://example.com/article" \
--timeout 60
Parameters
| Parameter | Default | Description |
|---|---|---|
--url |
(required) | URL to fetch and extract content from |
--timeout |
30 | Request timeout in seconds |
Output Contract
| Scenario | stdout | stderr | exit code |
|---|---|---|---|
| Success | Raw JSON from Jina | (empty) | 0 |
| Invalid URL | (empty) | Error message | 1 |
| Timeout | (empty) | Timeout error | 1 |
| HTTP Error | (empty) | HTTP error details | 1 |
Success output contains:
- Page title and description
- Clean extracted content (markdown-formatted)
- URL and metadata
- Token usage information
Prerequisites
- Uses Jina Reader API (no API key required)
- Requires
uvfor running PEP 723 scripts
Examples
Fetch a webpage
uv run --script scripts/web_fetch.py \
--url "https://docs.python.org/3/whatsnew/3.12.html"
Fetch with longer timeout for slow pages
uv run --script scripts/web_fetch.py \
--url "https://example.com/large-article" \
--timeout 60
Recommended Agent Skills
Expand your agent's capabilities with these related and highly-rated skills.
pi-delegate
Delegate tasks to Pi subagents with preset roles (oracle, worker, reviewer, ui-engineer, librarian) or ad-hoc prompts. Use for fresh context, model specialization, second opinions, code review, isolated execution, or parallel task delegation.
mcp-jetbrains-ide
Control JetBrains IDE (IntelliJ, WebStorm, PyCharm) via MCP. Use when manipulating IDE files, running configurations, searching code, or performing refactoring. Triggers on "open in IDE", "run configuration", "refactor code", "IDE search", "JetBrains".
mcp-context7-docs
Query up-to-date documentation and code examples for any programming library or framework. Use when looking up API docs, finding code examples, or checking library usage. Triggers on "how to use [library]", "docs for [package]", "show me examples of [framework]", "Context7 lookup".
tmux
Control interactive terminal sessions via tmux. Use when tasks need persistent REPLs, parallel CLI agents, or any process requiring a TTY that simple shell execution cannot handle.
specs-dev
Plan-first development workflow with review gates. Use when implementing features, refactoring, or any task requiring structured planning, iterative implementation with reviews, and clean commits. Triggers on requests like "implement feature X", "plan and build", "spec-driven development", or when user wants disciplined, reviewed code changes.
mcp-grep-code
Search real-world code examples from over a million public GitHub repositories. Use when finding code patterns, implementation examples, or how libraries are used in practice. Triggers on "find code examples", "how is [library] used", "search GitHub code", "grep.app search", "code pattern".
Didn't find tool you were looking for?