0 views collected around this technical thread.
This guide walks through setting up RabbitMQ via Docker, configuring Celery with FastAPI, defining asynchronous tasks, launching workers, testing endpoints, and monitoring execution with Flower, providing a complete, step‑by‑step solution for background processing in Python web applications.
Learn how to set up Redis with Docker, integrate it into a FastAPI app using a custom caching decorator, and apply Redis for caching API responses, rate limiting, task queues, and distributed locks, complete with practical code examples and deployment tips.
This article explains the LazyMan interview problem, demonstrates how to build a JavaScript function supporting chainable sleep, eat, and sleepFirst methods using task queues, and provides step‑by‑step code implementations with explanations and visual results.
This guide introduces the Python RQ library, shows how to install it with Redis, and provides multiple code examples covering queue creation, task execution, priority handling, timeouts, batch processing, scheduling, retries, and status tracking for building robust asynchronous back‑end systems.
This article introduces a Java virtual‑thread based asynchronous task framework, detailing its design constraints, a thread‑safe task queue, daemon thread management, and overloaded execute methods for Runnable and Groovy Closure, along with code examples and performance testing considerations.
This article introduces Python's multiprocessing module and the Celery task queue, explains their core concepts, and provides practical code examples for multi‑process parallel computation, inter‑process communication, asynchronous execution, scheduled jobs, result callbacks, retries, and distributed task orchestration.
This article reviews multiple ways to implement periodic tasks in Python, covering simple loops with sleep, libraries such as Timeloop, threading.Timer, sched, schedule, the APScheduler framework, as well as distributed solutions like Celery and Apache Airflow, and provides code examples for each method.
This article details the background, design choices, and architectural evolution of a distributed scheduling system—from a simple Redlock‑based implementation for real‑time alerts to a robust Bull‑powered task queue supporting complex scenarios, load balancing, persistence, and reliable execution across multiple Node.js servers.
This article provides a detailed tutorial on Celery, covering its architecture, installation, task structures, basic and advanced usage, integration with Django, and code examples for creating workers, scheduling tasks, and retrieving results, enabling developers to implement robust asynchronous processing in Python applications.
This guide explains how to set up Celery, a distributed asynchronous task framework, to use Redis both as the message broker and result backend, covering project structure, configuration code, task definition, execution, state monitoring, and common control operations.
This article provides a detailed overview of Celery, covering its architecture, common use cases, installation steps, project structure, task definition, periodic tasks, worker management, distributed deployment, advanced monitoring, custom task handling, task routing, and monitoring with Flower, all illustrated with practical code examples.
This article explains how Kuaishou's Y‑Tech team designs a server‑side video‑effects platform that tackles high computational load, real‑time constraints, and resource limits by adopting asynchronous workflows, task‑queue scheduling, and cloud‑native serverless frameworks such as Netflix Conductor and Knative.
This article presents the background, core features, system architecture, internal mechanisms, and practical extensions of ZZSCHEDULE, a distributed task scheduling platform built on the open‑source XXL‑JOB framework, detailing its design goals, HA strategies, task dependency handling, and deployment experiences at Zhuanzhuan.
lmstfy is a stateless, Redis‑backed task‑queue service from Meitu that provides delayed execution, automatic retries, priority handling, expiration, and a RESTful HTTP API, while supporting horizontal scaling via namespace‑based token routing, rich Prometheus metrics, and future disk‑based storage extensions.
This article explains why asynchronous processing is needed for large‑scale file export and import, outlines typical use cases, compares its pros and cons, and provides a detailed backend architecture, API design, and implementation guidelines with code snippets and diagrams.
Juice is an open‑source Mesos‑based distributed task scheduling framework that abstracts Docker tasks, provides REST APIs, leverages Redis queues, and implements custom resource allocation, offering high resource utilization and fault‑tolerant execution for audio‑video processing workloads.
This article explains how queues—such as message queues, task queues, and data‑bus queues—are applied in backend systems for asynchronous processing, system decoupling, data synchronization, traffic shaping, buffering, and other architectural patterns to improve scalability and reliability.