Agent skill
bull-mq
You are an expert in BullMQ, the high-performance job queue for Node.js built on Redis. You help developers build reliable background processing systems with delayed jobs, rate limiting, prioritization, repeatable cron jobs, job dependencies, concurrency control, and dead-letter handling — powering email sending, image processing, webhook delivery, report generation, and any async workload.
Install this agent skill to your Project
npx add-skill https://github.com/majiayu000/claude-skill-registry/tree/main/skills/other/other/bull-mq
Metadata
Additional technical details for this skill
- tags
-
queue redis jobs background worker cron node
- author
- terminal-skills
- version
- 1.0.0
- category
- Backend Development
SKILL.md
BullMQ — Redis-Based Job Queue for Node.js
You are an expert in BullMQ, the high-performance job queue for Node.js built on Redis. You help developers build reliable background processing systems with delayed jobs, rate limiting, prioritization, repeatable cron jobs, job dependencies, concurrency control, and dead-letter handling — powering email sending, image processing, webhook delivery, report generation, and any async workload.
Core Capabilities
Queue and Worker
import { Queue, Worker, QueueScheduler, FlowProducer } from "bullmq";
import IORedis from "ioredis";
const connection = new IORedis({ host: "localhost", port: 6379, maxRetriesPerRequest: null });
// Define queue
const emailQueue = new Queue("email", { connection });
// Add jobs
await emailQueue.add("welcome", {
to: "[email protected]",
template: "welcome",
data: { name: "Alice" },
}, {
priority: 1, // Lower = higher priority
attempts: 3, // Retry up to 3 times
backoff: { type: "exponential", delay: 2000 },
removeOnComplete: { count: 1000 }, // Keep last 1000 completed
removeOnFail: { age: 7 * 24 * 3600 }, // Keep failed for 7 days
});
// Delayed job
await emailQueue.add("reminder", { userId: 42 }, {
delay: 24 * 60 * 60 * 1000, // 24 hours from now
});
// Repeatable (cron)
await emailQueue.add("digest", {}, {
repeat: { pattern: "0 9 * * 1" }, // Every Monday at 9 AM
});
// Worker
const worker = new Worker("email", async (job) => {
switch (job.name) {
case "welcome":
await sendEmail(job.data.to, job.data.template, job.data.data);
break;
case "reminder":
await sendReminderEmail(job.data.userId);
break;
case "digest":
await sendWeeklyDigest();
break;
}
// Progress reporting
await job.updateProgress(100);
return { sent: true, timestamp: Date.now() };
}, {
connection,
concurrency: 5, // Process 5 jobs simultaneously
limiter: { max: 100, duration: 60000 }, // Rate limit: 100 jobs/min
});
worker.on("completed", (job, result) => console.log(`Job ${job.id} completed`));
worker.on("failed", (job, err) => console.error(`Job ${job?.id} failed: ${err.message}`));
Job Flows (Parent-Child Dependencies)
const flow = new FlowProducer({ connection });
await flow.add({
name: "generate-report",
queueName: "reports",
data: { reportId: "monthly-2026-03" },
children: [
{ name: "fetch-sales", queueName: "data", data: { source: "sales" } },
{ name: "fetch-users", queueName: "data", data: { source: "users" } },
{ name: "fetch-metrics", queueName: "data", data: { source: "metrics" } },
],
// Parent job runs only after ALL children complete
});
Installation
npm install bullmq ioredis
Best Practices
- Separate workers — Run workers in separate processes/containers from your API; scale independently
- Idempotent jobs — Design jobs to be safely retried; use unique job IDs to prevent duplicates
- Backoff strategy — Use exponential backoff for retries; prevents thundering herd on downstream failures
- Rate limiting — Use
limiterto respect API rate limits (email providers, webhooks, external APIs) - Progress tracking — Use
job.updateProgress()for long-running jobs; clients can poll progress - Graceful shutdown — Call
worker.close()on SIGTERM; finishes current jobs before exiting - Flows for pipelines — Use FlowProducer for job dependencies; parent waits for all children to complete
- Monitor with Bull Board — Use
@bull-board/expressfor a web UI showing queue status, job data, and failures
Recommended Agent Skills
Expand your agent's capabilities with these related and highly-rated skills.
majiayu000/claude-skill-registry
agent-ops-spec
Manage specification documents in .agent/specs/. Use when user provides requirements, acceptance criteria, or feature descriptions that need to be tracked and validated against implementation.
majiayu000/claude-skill-registry
agent-ops-state
Maintain .agent state files. Use at session start, after meaningful steps, and before concluding: read/update constitution/memory/focus/issues/baseline consistently.
majiayu000/claude-skill-registry
agent-ops-spec
Manage specification documents in .agent/specs/. Use when user provides requirements, acceptance criteria, or feature descriptions that need to be tracked and validated against implementation.
majiayu000/claude-skill-registry
agent-ops-testing
Test strategy, execution, and coverage analysis. Use when designing tests, running test suites, or analyzing test results beyond baseline checks.
majiayu000/claude-skill-registry
agent-ops-testing
Test strategy, execution, and coverage analysis. Use when designing tests, running test suites, or analyzing test results beyond baseline checks.
majiayu000/claude-skill-registry
agent-ops-state
Maintain .agent state files. Use at session start, after meaningful steps, and before concluding: read/update constitution/memory/focus/issues/baseline consistently.
Didn't find tool you were looking for?