Agent skill

haystack-pipeline

Haystack NLP pipeline configuration for document processing and QA

Stars 163
Forks 31

Install this agent skill to your Project

npx add-skill https://github.com/majiayu000/claude-skill-registry/tree/main/skills/other/other/haystack-pipeline

SKILL.md

Haystack Pipeline Skill

Capabilities

  • Configure Haystack pipeline components
  • Set up document stores and retrievers
  • Implement reader/generator models
  • Design custom pipeline graphs
  • Configure preprocessing pipelines
  • Implement evaluation pipelines

Target Processes

  • rag-pipeline-implementation
  • intent-classification-system

Implementation Details

Core Components

  1. DocumentStores: Elasticsearch, Weaviate, FAISS, etc.
  2. Retrievers: BM25, Dense, Hybrid
  3. Readers/Generators: Extractive and generative QA
  4. Preprocessors: Document cleaning and splitting

Pipeline Types

  • Retrieval pipelines
  • RAG pipelines
  • Evaluation pipelines
  • Indexing pipelines

Configuration Options

  • Component selection
  • Pipeline graph design
  • Document store backend
  • Model selection
  • Preprocessing settings

Best Practices

  • Modular pipeline design
  • Proper preprocessing
  • Evaluation integration
  • Component versioning

Dependencies

  • haystack-ai
  • farm-haystack (legacy)

Expand your agent's capabilities with these related and highly-rated skills.

Didn't find tool you were looking for?

Be as detailed as possible for better results