Agent skill

langfuse-integration

LangFuse LLM observability integration for tracing, analytics, and cost tracking

Stars 514
Forks 31

Install this agent skill to your Project

npx add-skill https://github.com/a5c-ai/babysitter/tree/main/library/specializations/ai-agents-conversational/skills/langfuse-integration

SKILL.md

LangFuse Integration Skill

Capabilities

  • Set up LangFuse tracing for LLM calls
  • Configure cost tracking and analytics
  • Implement prompt management
  • Set up evaluation datasets
  • Design custom trace metadata
  • Create dashboards and alerts

Target Processes

  • llm-observability-monitoring
  • cost-optimization-llm

Implementation Details

Core Features

  1. Tracing: Track LLM calls, chains, and agents
  2. Prompts: Version and manage prompts
  3. Analytics: Usage, latency, cost metrics
  4. Datasets: Evaluation and testing data
  5. Scores: Track output quality

Integration Methods

  • LangChain callback handler
  • Direct SDK integration
  • OpenAI drop-in replacement
  • Decorator-based tracing

Configuration Options

  • Public/secret keys
  • Host URL (cloud or self-hosted)
  • Sampling rate
  • Metadata configuration
  • User tracking

Best Practices

  • Consistent trace naming
  • Meaningful metadata
  • Regular prompt versioning
  • Set up alerting

Dependencies

  • langfuse
  • langchain (for callback integration)

Expand your agent's capabilities with these related and highly-rated skills.

a5c-ai/babysitter

gsd-tools

Central utility skill for GSD operations. Provides config parsing, slug generation, timestamps, path operations, and orchestrates calls to other specialized skills. Acts as the unified entry point that the original gsd-tools.cjs provided via its lib/ modules (commands, config, core, init).

514 31
Explore
a5c-ai/babysitter

model-profile-resolution

Resolve model profile (quality/balanced/budget) at orchestration start and map agents to specific models. Enables cost/quality tradeoffs by selecting appropriate AI models for each agent role.

514 31
Explore
a5c-ai/babysitter

verification-suite

Plan structure validation, phase completeness checks, reference integrity verification, and artifact existence confirmation. Provides the structured verification layer ensuring GSD artifacts are well-formed and complete.

514 31
Explore
a5c-ai/babysitter

state-management

STATE.md reading, writing, and field-level updates. Provides cross-session state persistence via .planning/STATE.md with structured fields for current task, completed phases, blockers, decisions, and quick tasks.

514 31
Explore
a5c-ai/babysitter

git-integration

Git commit patterns, formats, and conventions for GSD methodology. Provides atomic commits per task, structured commit messages, planning file commits, branch management, and milestone tag operations.

514 31
Explore
a5c-ai/babysitter

frontmatter-parsing

YAML frontmatter parsing and manipulation for .planning/ documents. Provides read, write, update, query, and validation operations on frontmatter blocks in GSD markdown artifacts.

514 31
Explore

Didn't find tool you were looking for?

Be as detailed as possible for better results