Event Looped logoEvent Looped
Practice
Learn
    • Overview
    • Scaling ReadsScaling WritesReal-time UpdatesDealing with ContentionMulti-step ProcessesHandling Large BlobsManaging Long-running TasksSecurity & Access Patterns
    • Key Technologies
    • System Design Problems
  • Company ProblemsNew
  • ArticlesBeta
Interview Preparation
  • Javascript Conceptual
  • Resume Builder
Patterns & Scaling

Managing Long-running Tasks

Async job management — task queues, job scheduling, progress tracking, retries, and the patterns that handle background work like video processing, report generation, and data pipelines.

Task Queuing

Master async job management — job queues vs message queues, priority queues, and dead-letter queues. Decouple task submission from execution for reliable background processing.

Job Queues vs Message QueuesPriority QueuesDead-Letter Queues (DLQ)

Scheduling

Orchestrate long-running tasks — cron-style job scheduling, distributed task coordination with locks and leader election, and progress tracking with status APIs.

Pro
Cron-Style Job SchedulingDistributed Task CoordinationProgress Tracking & Status APIs