Agent skill
deduplicate-articles
DEPRECATED: This skill has been replaced by memory/check_seen and memory/mark_seen tools. Use fetch-rss-feeds or other collection skills which handle deduplication automatically through the Memory MCP server.
Install this agent skill to your Project
npx add-skill https://github.com/majiayu000/claude-skill-registry/tree/main/skills/other/other/deduplicate-articles
Metadata
Additional technical details for this skill
- domain
- news
- status
- deprecated
- category
- collection
- confidence
- 0
- mcp servers
-
[]
- requires approval
- NO
SKILL.md
Deduplicate Articles (DEPRECATED)
⚠️ DEPRECATED: This skill has been deprecated as of v2.0.0.
Deduplication is now handled automatically by collection skills using the Memory MCP server's
check_seenandmark_seentools.
Migration Guide
Before (v1.0)
Collection and deduplication were separate skills:
fetch-rss-feeds- Collect articlesdeduplicate-articles- Remove duplicates
After (v2.0)
Deduplication is built into collection skills:
fetch-rss-feeds- Collects AND deduplicates using memory/check_seen
How to Migrate
If you were using deduplicate-articles, update your workflow to use the v2.0 collection skills which handle deduplication automatically.
The new approach:
- Before storing an article, call
memory/check_seenwith the article URL as key - If not seen, store the article with
memory/add - Mark as seen with
memory/mark_seen
This is now handled automatically by all collection skills.
Replacement Tools
| Old Approach | New Approach |
|---|---|
deduplicate-articles skill |
memory/check_seen + memory/mark_seen |
| In-memory URL set | Redis-backed deduplication with TTL |
| Per-run dedup only | Cross-run persistent deduplication |
Why Deprecated
- Redundant: Deduplication is now built into collection skills
- Better persistence: Memory MCP provides persistent deduplication with TTL
- Simpler workflows: One fewer skill to coordinate
- Consistency: All collection skills use the same deduplication mechanism
See Also
- fetch-rss-feeds - v2.0 with built-in dedup
- fetch-arxiv-papers - v2.0 with built-in dedup
- fetch-github-trending - v2.0 with built-in dedup
Recommended Agent Skills
Expand your agent's capabilities with these related and highly-rated skills.
majiayu000/claude-skill-registry
agent-ops-spec
Manage specification documents in .agent/specs/. Use when user provides requirements, acceptance criteria, or feature descriptions that need to be tracked and validated against implementation.
majiayu000/claude-skill-registry
agent-ops-state
Maintain .agent state files. Use at session start, after meaningful steps, and before concluding: read/update constitution/memory/focus/issues/baseline consistently.
majiayu000/claude-skill-registry
agent-ops-spec
Manage specification documents in .agent/specs/. Use when user provides requirements, acceptance criteria, or feature descriptions that need to be tracked and validated against implementation.
majiayu000/claude-skill-registry
agent-ops-testing
Test strategy, execution, and coverage analysis. Use when designing tests, running test suites, or analyzing test results beyond baseline checks.
majiayu000/claude-skill-registry
agent-ops-testing
Test strategy, execution, and coverage analysis. Use when designing tests, running test suites, or analyzing test results beyond baseline checks.
majiayu000/claude-skill-registry
agent-ops-state
Maintain .agent state files. Use at session start, after meaningful steps, and before concluding: read/update constitution/memory/focus/issues/baseline consistently.
Didn't find tool you were looking for?