ReddRadar
Agent skill
context-scrapers
Web scraping spiders (Scrapy), parsers, and source management.
Install this agent skill to your Project
npx add-skill https://github.com/majiayu000/claude-skill-registry/tree/main/skills/data/context-scrapers
SKILL.md
Scrapers Context
Overview
Web scraping infrastructure using Scrapy. Handles data acquisition from city councils (Legistar) and municipal codes (Municode).
Active Files
Spiders
backend/affordabot_scraper/affordabot_scraper/spiders/sanjose_meetings.py- Legistar meeting scraperbackend/affordabot_scraper/affordabot_scraper/spiders/sanjose_municode.py- Municode scraper
Configuration
backend/affordabot_scraper/affordabot_scraper/pipelines.py- Item pipelines (DB storage)backend/affordabot_scraper/affordabot_scraper/settings.py- Scrapy settings
Verification Scripts
scripts/verify_raw_scrapes.py- Check raw_scrapes tablescripts/verify_municode_discovery.py- Verify discovery logic
Usage
Use this skill when modifying scrapers, adding new jurisdictions, or debugging ingestion.
Recommended Agent Skills
Expand your agent's capabilities with these related and highly-rated skills.
majiayu000/claude-skill-registry
agent-ops-spec
Manage specification documents in .agent/specs/. Use when user provides requirements, acceptance criteria, or feature descriptions that need to be tracked and validated against implementation.
majiayu000/claude-skill-registry
agent-ops-state
Maintain .agent state files. Use at session start, after meaningful steps, and before concluding: read/update constitution/memory/focus/issues/baseline consistently.
majiayu000/claude-skill-registry
agent-ops-spec
Manage specification documents in .agent/specs/. Use when user provides requirements, acceptance criteria, or feature descriptions that need to be tracked and validated against implementation.
majiayu000/claude-skill-registry
agent-ops-testing
Test strategy, execution, and coverage analysis. Use when designing tests, running test suites, or analyzing test results beyond baseline checks.
majiayu000/claude-skill-registry
agent-ops-testing
Test strategy, execution, and coverage analysis. Use when designing tests, running test suites, or analyzing test results beyond baseline checks.
majiayu000/claude-skill-registry
agent-ops-state
Maintain .agent state files. Use at session start, after meaningful steps, and before concluding: read/update constitution/memory/focus/issues/baseline consistently.
Didn't find tool you were looking for?