0 views collected around this technical thread.
This guide walks through setting up RabbitMQ via Docker, configuring Celery with FastAPI, defining asynchronous tasks, launching workers, testing endpoints, and monitoring execution with Flower, providing a complete, step‑by‑step solution for background processing in Python web applications.
This article provides a comprehensive guide to five methods for running Python scripts in the background on Linux, covering nohup with &, screen sessions, systemd services, Celery task queues, and supervisord, including command examples and configuration steps.
This article introduces eight practical Python solutions for creating scheduled tasks, ranging from simple time.sleep loops to advanced libraries like APScheduler, Celery, and system tools such as cron, each accompanied by clear code examples and usage explanations.
This article presents a comprehensive guide to implementing periodic tasks in Python, covering eight approaches including simple while‑loop with sleep, Timeloop, threading.Timer, sched, schedule, APScheduler, Celery, and Apache Airflow, each with code examples and practical notes.
This article introduces Python's multiprocessing module and the Celery task queue, explains their core concepts, and provides practical code examples for multi‑process parallel computation, inter‑process communication, asynchronous execution, scheduled jobs, result callbacks, retries, and distributed task orchestration.
This article explains how to use Celery together with Redis to manage and execute periodic and asynchronous tasks in Python, covering basic concepts, architecture, configuration steps, single‑worker and multi‑worker setups, distributed processing strategies, and practical considerations for reliable task execution.
This article reviews multiple ways to implement periodic tasks in Python, covering simple loops with sleep, libraries such as Timeloop, threading.Timer, sched, schedule, the APScheduler framework, as well as distributed solutions like Celery and Apache Airflow, and provides code examples for each method.
This article introduces Python's multiprocessing module and the Celery distributed task queue, explains their core features, and provides ten practical code examples demonstrating multi‑process parallel computation, inter‑process communication, asynchronous tasks, scheduling, retries, and distributed processing for real‑world applications.
The paper presents a scalable sFlow‑based traffic analysis system that combines high‑performance agents, collectors, and analyzers—extending Elastiflow with sFlowtool, Logstash, Kafka, and Elasticsearch/Kibana, while adding CMDB integration, Druid storage, and Celery stream processing to achieve sub‑30‑second latency for data‑center monitoring, anomaly detection, and IP‑level analytics, and discusses future needs for broader protocol support and adaptive collection.
This article reviews several Python approaches for creating scheduled or periodic jobs—including a simple while‑True loop with sleep, the Timeloop library, the built‑in sched module, the schedule package, APScheduler, Celery, and Apache Airflow—explaining their usage, advantages, limitations, and providing ready‑to‑run code samples.
This article provides a detailed tutorial on Celery, covering its architecture, installation, task structures, basic and advanced usage, integration with Django, and code examples for creating workers, scheduling tasks, and retrieving results, enabling developers to implement robust asynchronous processing in Python applications.
This guide explains how to set up Celery, a distributed asynchronous task framework, to use Redis both as the message broker and result backend, covering project structure, configuration code, task definition, execution, state monitoring, and common control operations.
This article provides a detailed overview of Celery, covering its architecture, common use cases, installation steps, project structure, task definition, periodic tasks, worker management, distributed deployment, advanced monitoring, custom task handling, task routing, and monitoring with Flower, all illustrated with practical code examples.
This article provides a comprehensive overview of various Python approaches for implementing periodic tasks, including simple loops with sleep, third‑party libraries such as Timeloop, schedule, APScheduler, as well as distributed solutions like Celery and Apache Airflow, complete with code examples and architectural explanations.
This article presents a comprehensive guide to implementing periodic tasks in Python, covering simple while‑loop with sleep, Timeloop, threading.Timer, the built‑in sched module, the schedule library, APScheduler, Celery, and Apache Airflow, with code examples and practical tips.
The article presents DuLab, a distributed UI‑automation platform for mobile apps that leverages Airtest, Python/Tornado, Celery, and Redis to schedule and run bulk test cases on remote devices, detailing its layered case management, package database, mock services, and the resulting scalable, efficient regression testing across diverse devices.
This article describes Qunar's DBA department automated migration platform, detailing its motivation, overall architecture, task pool and templates, customizable web‑based workflow, scheduling, execution queue, tooling, and the significant efficiency and reliability gains achieved across numerous database migration scenarios.
This guide explains how to set up DjCelery—combining Django and Celery—to create, schedule, and manage automated testing tasks such as single‑interface, API, App, and Web UI scripts, replacing Jenkins‑based cron jobs with a fully integrated backend solution.
After costly data‑deletion mishaps, 37 Interactive Entertainment engineered a robust, multi‑region backup platform that evolved from simple cron scripts to streaming xtrabackup with Celery‑driven task queues, encrypted HDFS/S3 storage, automated rotation and restore verification, ensuring reliable protection against high‑impact data loss.
This article explains how attackers can combine SSRF vulnerabilities with unauthorized Redis access and unsafe serialization in Celery to infiltrate internal networks, illustrating the attack flow, exploitation techniques, and mitigation considerations for operations and security teams.