Agent skill
article-extraction
Extract clean article content from web pages, removing ads and clutter for reading and archiving
Install this agent skill to your Project
npx add-skill https://github.com/ljchg12-hue/dotfiles/tree/main/skills/article-extraction
SKILL.md
Article Extraction Skill
Extract clean article text from web pages, removing ads, navigation, and clutter.
When to Use
- Content archiving
- Research collection
- Reading list management
- Content analysis
Core Capabilities
- Main content extraction
- Metadata extraction (title, author, date)
- Image extraction
- Clean HTML/Markdown output
- Multi-page article handling
- Paywall bypass (where legal)
Tools
# Readability (Node.js)
npm install @mozilla/readability
# newspaper3k (Python)
pip install newspaper3k
python -c "from newspaper import Article; a = Article('URL'); a.download(); a.parse(); print(a.text)"
# Trafilatura (Python)
pip install trafilatura
trafilatura -u "URL"
Best Practices
- Respect robots.txt
- Cache extracted content
- Preserve attribution
- Handle different CMS formats
Resources
- Readability: https://github.com/mozilla/readability
- newspaper3k: https://github.com/codelucas/newspaper
Recommended Agent Skills
Expand your agent's capabilities with these related and highly-rated skills.
ljchg12-hue/dotfiles
random-selection
Randomly select items from lists using various algorithms for fair and unbiased selection
ljchg12-hue/dotfiles
threat-hunting
Proactive threat detection using Sigma rules, IOCs, and behavioral analytics
ljchg12-hue/dotfiles
auth-implementation-patterns
Master authentication and authorization patterns including JWT, OAuth2, session management, and RBAC to build secure, scalable access control systems. Use when implementing auth systems, securing APIs, or debugging security issues.
ljchg12-hue/dotfiles
debugging-strategies
Master systematic debugging techniques, profiling tools, and root cause analysis to efficiently track down bugs across any codebase or technology stack. Use when investigating bugs, performance issues, or unexpected behavior.
ljchg12-hue/dotfiles
sql-optimization-patterns
Master SQL query optimization, indexing strategies, and EXPLAIN analysis to dramatically improve database performance and eliminate slow queries. Use when debugging slow queries, designing database schemas, or optimizing application performance.
ljchg12-hue/dotfiles
monorepo-management
Master monorepo management with Turborepo, Nx, and pnpm workspaces to build efficient, scalable multi-package repositories with optimized builds and dependency management. Use when setting up monorepos, optimizing builds, or managing shared dependencies.
Didn't find tool you were looking for?