Agent skill

web-fetch

Fetch and extract clean content from URLs using Jina Reader API. Use when users need to read webpage content, extract article text, or fetch URL content for analysis. Triggers on "fetch this page", "read this URL", "extract content from", "get the content of", "what does this page say".

Stars 33
Forks 3

Install this agent skill to your Project

npx add-skill https://github.com/vaayne/agent-kit/tree/main/skills/web-fetch

SKILL.md

Web Fetch

Overview

Extract clean, readable content from any URL using Jina Reader API. Returns raw JSON with title, content, and metadata optimized for LLM consumption.

When to Use

  • User wants to read or analyze webpage content
  • Need to extract article text from a URL
  • Fetching documentation or reference pages
  • Converting web pages to clean text for processing

Workflow

  1. Identify the URL from user request
  2. Validate URL format
  3. Run the fetch script
  4. Present extracted content to user

Usage

bash
# Basic fetch
uv run --script scripts/web_fetch.py --url "https://example.com"

# With custom timeout
uv run --script scripts/web_fetch.py \
  --url "https://example.com/article" \
  --timeout 60

Parameters

Parameter Default Description
--url (required) URL to fetch and extract content from
--timeout 30 Request timeout in seconds

Output Contract

Scenario stdout stderr exit code
Success Raw JSON from Jina (empty) 0
Invalid URL (empty) Error message 1
Timeout (empty) Timeout error 1
HTTP Error (empty) HTTP error details 1

Success output contains:

  • Page title and description
  • Clean extracted content (markdown-formatted)
  • URL and metadata
  • Token usage information

Prerequisites

  • Uses Jina Reader API (no API key required)
  • Requires uv for running PEP 723 scripts

Examples

Fetch a webpage

bash
uv run --script scripts/web_fetch.py \
  --url "https://docs.python.org/3/whatsnew/3.12.html"

Fetch with longer timeout for slow pages

bash
uv run --script scripts/web_fetch.py \
  --url "https://example.com/large-article" \
  --timeout 60

Expand your agent's capabilities with these related and highly-rated skills.

vaayne/agent-kit

pi-delegate

Delegate tasks to Pi subagents with preset roles (oracle, worker, reviewer, ui-engineer, librarian) or ad-hoc prompts. Use for fresh context, model specialization, second opinions, code review, isolated execution, or parallel task delegation.

33 3
Explore
vaayne/agent-kit

mcp-jetbrains-ide

Control JetBrains IDE (IntelliJ, WebStorm, PyCharm) via MCP. Use when manipulating IDE files, running configurations, searching code, or performing refactoring. Triggers on "open in IDE", "run configuration", "refactor code", "IDE search", "JetBrains".

33 3
Explore
vaayne/agent-kit

mcp-context7-docs

Query up-to-date documentation and code examples for any programming library or framework. Use when looking up API docs, finding code examples, or checking library usage. Triggers on "how to use [library]", "docs for [package]", "show me examples of [framework]", "Context7 lookup".

33 3
Explore
vaayne/agent-kit

tmux

Control interactive terminal sessions via tmux. Use when tasks need persistent REPLs, parallel CLI agents, or any process requiring a TTY that simple shell execution cannot handle.

33 3
Explore
vaayne/agent-kit

specs-dev

Plan-first development workflow with review gates. Use when implementing features, refactoring, or any task requiring structured planning, iterative implementation with reviews, and clean commits. Triggers on requests like "implement feature X", "plan and build", "spec-driven development", or when user wants disciplined, reviewed code changes.

33 3
Explore
vaayne/agent-kit

mcp-grep-code

Search real-world code examples from over a million public GitHub repositories. Use when finding code patterns, implementation examples, or how libraries are used in practice. Triggers on "find code examples", "how is [library] used", "search GitHub code", "grep.app search", "code pattern".

33 3
Explore

Didn't find tool you were looking for?

Be as detailed as possible for better results