BestHub
Sign in
Tagged articles

task scheduling

211 articles · Page 2 of 3
Java Architect Essentials
Java Architect Essentials
Feb 2, 2023 · Backend Development

Comparison of Distributed Task Scheduling Frameworks: Elastic‑Job vs X‑Job and Other Solutions

This article examines common business scenarios that require timed execution, introduces single‑machine and distributed scheduling frameworks such as Timer, ScheduledExecutorService, Spring, Quartz, TBSchedule, Elastic‑Job, Saturn and XXL‑Job, and provides a detailed feature‑by‑feature comparison to help choose the most suitable solution.

BackendElastic-JobJava
0 likes · 14 min read
Comparison of Distributed Task Scheduling Frameworks: Elastic‑Job vs X‑Job and Other Solutions
Java Architect Essentials
Java Architect Essentials
Feb 1, 2023 · Backend Development

Comparison of Distributed Task Scheduling Frameworks: Elastic-Job vs X-Job and Others

The article examines common business scenarios requiring timed actions and reviews both single‑machine and distributed scheduling solutions, detailing frameworks such as Timer, ScheduledExecutorService, Spring, Quartz, TBSchedule, elastic‑job, Saturn and xxl‑job, then provides a side‑by‑side comparison and practical recommendations.

BackendElastic-JobJava
0 likes · 14 min read
Comparison of Distributed Task Scheduling Frameworks: Elastic-Job vs X-Job and Others
Open Source Linux
Open Source Linux
Jan 13, 2023 · Operations

Mastering crontab: Common Pitfalls and How to Fix Them

This guide explains what crontab does, its syntax and options, provides practical examples, highlights typical problems such as environment variables, time misconfiguration, special characters and output redirection, and offers debugging tips and tools for reliable Linux task scheduling.

CronLinuxdebugging
0 likes · 15 min read
Mastering crontab: Common Pitfalls and How to Fix Them
Alibaba Cloud Infrastructure
Alibaba Cloud Infrastructure
Jan 10, 2023 · Cloud Computing

Collaborative Optimization of Data Center Computing Power Based on Flexible Business Load Scheduling

The CCF‑AIR Youth Fund project on flexible business‑load scheduling demonstrated a low‑carbon, cost‑effective data‑center computing power coordination method that can cut energy costs by 37% and carbon‑related costs by 14% through renewable‑energy‑driven collaboration with the power grid.

Cloud ComputingLow CarbonRenewable Energy
0 likes · 6 min read
Collaborative Optimization of Data Center Computing Power Based on Flexible Business Load Scheduling
DataFunTalk
DataFunTalk
Jan 3, 2023 · Big Data

Tencent Unified Big Data Scheduling Platform – Architecture, Design, and Operations

The article presents an in‑depth overview of Tencent's self‑developed Unified Scheduling Platform, detailing its system architecture, design challenges, performance optimizations, resource‑fair scheduling mechanisms, operational metrics, future roadmap, and a Q&A session that together illustrate how the platform enables massive offline data processing at scale.

Performance Optimizationbig datadistributed systems
0 likes · 18 min read
Tencent Unified Big Data Scheduling Platform – Architecture, Design, and Operations
ITPUB
ITPUB
Dec 29, 2022 · Databases

How TDSQL‑C Accelerates Parallel Queries in Cloud‑Native Databases

This transcript details the design, implementation, and performance evaluation of TDSQL‑C's parallel query feature, covering product background, workload challenges, execution plans, Amdahl's law analysis, task scheduling, data partitioning, and future enhancements for cloud‑native database systems.

Amdahl's LawCloud-Native DatabaseData Partitioning
0 likes · 17 min read
How TDSQL‑C Accelerates Parallel Queries in Cloud‑Native Databases
Liangxu Linux
Liangxu Linux
Dec 24, 2022 · Operations

Mastering crontab: Common Pitfalls, Debugging Tips, and Practical Examples

This guide explains what crontab does, how to write and manage user and system cron jobs, shows real‑world syntax examples, highlights typical pitfalls such as environment variables, time fields, special characters and output redirection, and provides debugging strategies including the crontab.guru online parser.

CronLinuxcrontab
0 likes · 15 min read
Mastering crontab: Common Pitfalls, Debugging Tips, and Practical Examples
DataFunSummit
DataFunSummit
Dec 4, 2022 · Big Data

Star River Data Scheduling Platform: Architecture, Evolution, and Intelligent Operations at 58.com

This article details the design, evolution, and core capabilities of 58.com's self‑developed Star River data scheduling platform, covering its positioning, architectural challenges, high‑availability master design, intelligent monitoring, baseline management, and future roadmap for big‑data operations.

Resource Isolationhigh availabilityintelligent operations
0 likes · 15 min read
Star River Data Scheduling Platform: Architecture, Evolution, and Intelligent Operations at 58.com
ITPUB
ITPUB
Nov 25, 2022 · Big Data

How Berserker’s Big Data Platform Solved Scheduling, State and Scaling Challenges

This article details the architecture, evolution, and technical solutions of the Berserker big‑data platform—including component design, state‑management problems, release strategies, two‑phase commit, RPC handling, routing, message queuing, containerized execution, dependency model redesign, and future roadmap—demonstrating how the system achieved high availability, low latency, and scalable operations.

DockerKubernetesRaft
0 likes · 19 min read
How Berserker’s Big Data Platform Solved Scheduling, State and Scaling Challenges
StarRocks
StarRocks
Nov 15, 2022 · Databases

How StarRocks 2.5 Improves Materialized Views for Real‑Time and Offline Queries

This article analyzes the requirements, design choices, and implementation details of materialized views in StarRocks, covering demand analysis, synchronous and asynchronous refresh solutions, partition binding, task scheduling, partition‑refresh maintenance, Insert‑Overwrite mechanics, view invalidation handling, and the upcoming features planned for version 2.5.

Async RefreshInsert OverwriteMaterialized View
0 likes · 14 min read
How StarRocks 2.5 Improves Materialized Views for Real‑Time and Offline Queries
macrozheng
macrozheng
Nov 10, 2022 · Backend Development

How to Pick a Task Scheduling Framework: Quartz, ElasticJob, XXL‑JOB

This article compares popular Java task scheduling solutions—including Quartz, ElasticJob‑Lite, XXL‑JOB, and custom implementations—explaining their core components, clustering strategies, distributed lock mechanisms, and practical code examples to help engineers choose the right framework for their needs.

ElasticJobbackend developmentquartz
0 likes · 20 min read
How to Pick a Task Scheduling Framework: Quartz, ElasticJob, XXL‑JOB
Cognitive Technology Team
Cognitive Technology Team
Oct 16, 2022 · Backend Development

Understanding ScheduledThreadPoolExecutor: Task Types, Configuration, and Common Pitfalls

This article explains the different delay and periodic task types supported by Java's ScheduledThreadPoolExecutor, details its constructor parameters and default settings, and highlights common pitfalls such as exception loss, inaccurate scheduling, and improper core pool size configuration.

ConcurrencyJavaScheduledThreadPoolExecutor
0 likes · 5 min read
Understanding ScheduledThreadPoolExecutor: Task Types, Configuration, and Common Pitfalls
IT Services Circle
IT Services Circle
Oct 4, 2022 · Backend Development

Creating an Auto‑Register Spring Boot Starter for XXL‑Job Executors and JobHandlers

This article explains how to build a Spring Boot starter that automatically registers XXL‑Job executors and job handlers by logging into the admin center, invoking the necessary REST APIs, and using custom annotations to capture job metadata, eliminating manual configuration for large numbers of scheduled tasks.

StarterXXL-JOBauto registration
0 likes · 12 min read
Creating an Auto‑Register Spring Boot Starter for XXL‑Job Executors and JobHandlers
ITPUB
ITPUB
Sep 24, 2022 · Operations

How Alibaba Cloud Log Service Scales Billion‑Task Scheduling: Design and Practice

This article explains how Alibaba Cloud Log Service implements a billion‑scale task scheduling framework for its observability platform, covering background, task types, design goals, architecture, key design points, and practical examples such as aggregation jobs and various scheduling scenarios.

large-scalelog servicemaster-worker
0 likes · 22 min read
How Alibaba Cloud Log Service Scales Billion‑Task Scheduling: Design and Practice
ITFLY8 Architecture Home
ITFLY8 Architecture Home
Sep 13, 2022 · Backend Development

Choosing the Right Java Scheduling Framework: Timer, Quartz, Elastic-Job, X-Job Compared

This article examines common business scenarios that require timed execution, explains why scheduled tasks are essential, compares standalone and distributed Java scheduling frameworks—including Timer, ScheduledExecutorService, Spring, Quartz, TBSchedule, Elastic-Job, Saturn, and XXL-Job—and provides guidance on selecting the most suitable solution based on scalability, reliability, and operational needs.

Javabackend developmentdistributed systems
0 likes · 14 min read
Choosing the Right Java Scheduling Framework: Timer, Quartz, Elastic-Job, X-Job Compared
Alibaba Cloud Native
Alibaba Cloud Native
Sep 1, 2022 · Operations

Which Scheduling Solution Fits Your Enterprise? Crontab, Spring Task, ElasticJob, XXLJob or Serverless

This article compares five popular enterprise scheduling solutions—Crontab, Spring Task, ElasticJob, XXLJob, and Serverless Job—by outlining their goals, usage patterns, implementation details, and common pain points, helping architects choose the most suitable option for cloud‑native environments.

ElasticJobSpring Taskcrontab
0 likes · 18 min read
Which Scheduling Solution Fits Your Enterprise? Crontab, Spring Task, ElasticJob, XXLJob or Serverless
Alipay Experience Technology
Alipay Experience Technology
Aug 22, 2022 · Mobile Development

How Alipay Engineers Built a Fine‑Grained Scheduling System for Mobile Apps

This article details Alipay's evolution from basic thread pools to a sophisticated, multi‑layered scheduling framework that balances UI responsiveness, task prioritization, and resource control across Android devices, while outlining the technical challenges and future directions of fine‑grained scheduling.

AndroidPerformance Optimizationtask scheduling
0 likes · 13 min read
How Alipay Engineers Built a Fine‑Grained Scheduling System for Mobile Apps
Baidu App Technology
Baidu App Technology
Aug 19, 2022 · Mobile Development

Baidu App Low-End Device Startup Performance Optimization: A Comprehensive Guide

Baidu’s comprehensive low‑end device startup optimization—using a scoring‑based observation system, TTI metrics, automated degradation prevention, high‑performance tools such as UniKV and ABTest lock fixes, and an intelligent scheduling framework—cut cold‑start TTI by over 40% on Android and 30%‑plus on iOS.

Android optimizationdegradation preventionios-optimization
0 likes · 19 min read
Baidu App Low-End Device Startup Performance Optimization: A Comprehensive Guide
Past Memory Big Data
Past Memory Big Data
Aug 9, 2022 · Big Data

Master the Complete Big Data Ecosystem in One Article

This article provides a comprehensive overview of the big data ecosystem, detailing nine core technology categories—from data collection and storage to computation, analysis, scheduling, and underlying infrastructure—along with tool comparisons, selection guidelines to help readers quickly build a complete big data knowledge system.

Data AnalysisData StorageZooKeeper
0 likes · 12 min read
Master the Complete Big Data Ecosystem in One Article
360 Quality & Efficiency
360 Quality & Efficiency
Jul 15, 2022 · Backend Development

Using APScheduler for Asynchronous Task Scheduling in Flask

This article introduces the Python APScheduler framework, explains its four core components, shows how to install it, and provides a step‑by‑step guide for integrating background task scheduling into a Flask application with appropriate scheduler, job store, executor, and trigger selections.

@AsyncAPSchedulerBackgroundScheduler
0 likes · 6 min read
Using APScheduler for Asynchronous Task Scheduling in Flask
Baidu Geek Talk
Baidu Geek Talk
Jun 28, 2022 · Artificial Intelligence

Intelligent Test Execution Practices: Risk‑Based Manual Test Recommendation, Parallel‑Coverage Traffic Filtering, Smart Build, and Priority‑Based Task Scheduling

The article covers intelligent test execution practices: risk‑based manual test recommendation, parallel‑coverage traffic filtering, smart build, priority‑based task scheduling, and UI automation self‑healing, describing methods, algorithms, and results that reduce test volume, speed up regression, and improve stability.

UI self-healingsmart buildtask scheduling
0 likes · 12 min read
Intelligent Test Execution Practices: Risk‑Based Manual Test Recommendation, Parallel‑Coverage Traffic Filtering, Smart Build, and Priority‑Based Task Scheduling
SQB Blog
SQB Blog
Jun 24, 2022 · Fundamentals

Unlocking Embedded RTOS: A Deep Dive into Multi‑Task Scheduling, IPC, and Chip Porting

This comprehensive guide explores the fundamentals of embedded real‑time operating systems, covering instruction set architecture, hardware‑software ecosystems, multi‑task scheduling algorithms, inter‑process communication primitives, software timers, and concrete RISC‑V and Cortex‑M porting implementations with Rust and assembly examples.

RTOSRustassembly
0 likes · 65 min read
Unlocking Embedded RTOS: A Deep Dive into Multi‑Task Scheduling, IPC, and Chip Porting
Laravel Tech Community
Laravel Tech Community
May 30, 2022 · Operations

Understanding and Using crontab for Task Scheduling on Linux

This guide explains how to install, start, and stop the crontab service, configure global and user-specific cron directories, write crontab entries with proper syntax, and apply advanced techniques such as output redirection, nohup, background execution, and date-based log naming for reliable Linux task automation.

Cron JobsLinuxcrontab
0 likes · 9 min read
Understanding and Using crontab for Task Scheduling on Linux
Code Ape Tech Column
Code Ape Tech Column
Apr 27, 2022 · Backend Development

Understanding Task Scheduling: Quartz, Distributed Locks, ElasticJob‑Lite, XXL‑JOB and a Custom Solution

This article explains the core concepts, architectures and trade‑offs of several Java task‑scheduling solutions—including Quartz, Redis/Zookeeper distributed locks, ElasticJob‑Lite, XXL‑JOB and a self‑built scheduler—while providing code examples and practical guidance for building reliable, scalable job execution systems.

ElasticJobJavaXXL-JOB
0 likes · 17 min read
Understanding Task Scheduling: Quartz, Distributed Locks, ElasticJob‑Lite, XXL‑JOB and a Custom Solution
DataFunTalk
DataFunTalk
Apr 12, 2022 · Big Data

Kuaishou Big Data Task Scheduling System: Architecture, Challenges, and Key Technologies

This article presents Kuaishou's large‑scale big‑data task scheduling system, describing its evolution from Airflow to the self‑developed Kwaiflow, the performance and reliability challenges of handling hundreds of thousands of tasks, and the design decisions that achieve low latency, high availability, and strong open capabilities.

KuaishouKwaiflowdistributed systems
0 likes · 22 min read
Kuaishou Big Data Task Scheduling System: Architecture, Challenges, and Key Technologies
IT Services Circle
IT Services Circle
Apr 6, 2022 · Backend Development

Getting Started with XXL‑Job: Installation, Configuration, and Developing Scheduled Tasks

This tutorial walks through the entire lifecycle of using the XXL‑Job distributed scheduling framework—including a brief comparison with ElasticJob, downloading and running the admin console, configuring the MySQL database, setting up a SpringBoot project, adding dependencies, writing Bean‑based and GLUE tasks, registering the executor, and finally creating and monitoring scheduled jobs via the web UI.

JavaSpringBootXXL-JOB
0 likes · 13 min read
Getting Started with XXL‑Job: Installation, Configuration, and Developing Scheduled Tasks
Ziru Technology
Ziru Technology
Apr 1, 2022 · Fundamentals

How Kafka’s Hierarchical Timing Wheel Optimizes Task Scheduling

This article explains the time‑wheel algorithm, from its basic circular‑buffer principle to simple, round‑based, and hierarchical variants, and shows how Kafka implements a multi‑level timing wheel to achieve efficient, low‑memory delayed task execution.

Kafkabackend algorithmshierarchical timer
0 likes · 13 min read
How Kafka’s Hierarchical Timing Wheel Optimizes Task Scheduling
Java Backend Technology
Java Backend Technology
Mar 26, 2022 · Backend Development

XXL-JOB Mastery: A Step-by-Step Spring Boot Guide to Distributed Scheduling

This tutorial walks you through installing and configuring the open‑source XXL‑JOB scheduler, comparing it with ElasticJob, setting up the admin console, creating a Spring Boot project, adding the necessary dependencies, configuring database and logging, and implementing scheduled tasks using Bean, Method, and GLUE modes, complete with code examples and screenshots.

XXL-JOBdistributed systemstask scheduling
0 likes · 15 min read
XXL-JOB Mastery: A Step-by-Step Spring Boot Guide to Distributed Scheduling
Sohu Tech Products
Sohu Tech Products
Mar 2, 2022 · Mobile Development

Designing a Robust Android App Startup Framework with Annotation Processing and Task Scheduling

This article explains how to build a high‑performance Android startup framework by collecting initialization tasks with custom annotations, generating code via annotation processors, injecting tasks into the application, and scheduling them using a DAG‑based algorithm that supports async execution, multi‑process, and priority handling.

AndroidAnnotation ProcessingKotlin
0 likes · 11 min read
Designing a Robust Android App Startup Framework with Annotation Processing and Task Scheduling
ByteDance SE Lab
ByteDance SE Lab
Dec 31, 2021 · Mobile Development

How to Slash iOS App Startup Time: Strategies from the Watermelon App

This article details the Watermelon iOS app's comprehensive startup optimization, covering launch phase definitions, metric design, task scheduling, code instrumentation, thread management, rendering and network improvements, as well as monitoring and anti‑regression measures to consistently reduce launch latency.

iOSnetwork optimizationstartup-optimization
0 likes · 24 min read
How to Slash iOS App Startup Time: Strategies from the Watermelon App
ByteDance Terminal Technology
ByteDance Terminal Technology
Dec 28, 2021 · Mobile Development

Analyzing Gradle’s Scheduling Mechanism to Optimize Android Component Publishing

This article investigates why large Android projects experience extremely slow AAR publishing, reveals that memory is not the main bottleneck, examines Gradle’s core scheduling, Worker API, lock contention, and measurement inaccuracies, and proposes disabling Worker API to achieve up to fifteen‑fold build speed improvements.

AndroidGradleParallelism
0 likes · 20 min read
Analyzing Gradle’s Scheduling Mechanism to Optimize Android Component Publishing
Beike Product & Technology
Beike Product & Technology
Dec 23, 2021 · Frontend Development

How React Fiber’s Time‑Slicing Makes UI Updates Seamlessly Smooth

An in‑depth walkthrough of React’s Fiber architecture reveals how time‑slicing and a linked‑list Fiber tree replace the stack‑based reconciler of React 15, delivering smoother UI updates, priority‑based task scheduling, and interruptible rendering, complete with code examples, performance comparisons, and the underlying event‑loop mechanics.

FiberPerformanceReAct
0 likes · 12 min read
How React Fiber’s Time‑Slicing Makes UI Updates Seamlessly Smooth
Xiao Lou's Tech Notes
Xiao Lou's Tech Notes
Dec 16, 2021 · Backend Development

From Druid to MetaQ: A Developer’s Journey Through Middleware Mastery

This article chronicles a developer’s personal and technical evolution—from refactoring a lottery service with Druid, exploring Cobar sharding, diving deep into MetaQ’s messaging model, to designing custom task‑scheduling systems—highlighting lessons learned, architectural insights, and the enduring value of connecting the dots in software engineering.

Backendmessage queuemiddleware
0 likes · 16 min read
From Druid to MetaQ: A Developer’s Journey Through Middleware Mastery
Tencent Cloud Developer
Tencent Cloud Developer
Dec 8, 2021 · Cloud Native

Using Tencent Cloud EKS Virtual Nodes to Solve CronJob Isolation and Scheduling Challenges

By offloading thousands of short‑lived CronJob pods to Tencent Cloud EKS serverless virtual nodes, Zuoyebang isolated them from online services, eliminated IP waste, achieved millisecond‑level parallel scheduling and sub‑3‑second startup, freed 10 % of cluster resources and cut scheduling costs by roughly 70 % while markedly improving cluster stability.

Cluster stabilityCronJobKubernetes
0 likes · 10 min read
Using Tencent Cloud EKS Virtual Nodes to Solve CronJob Isolation and Scheduling Challenges
Tencent Qidian Tech Team
Tencent Qidian Tech Team
Dec 2, 2021 · Backend Development

How a Priority‑Queue Scheduler Supercharged Client Performance

This article examines client‑side performance bottlenecks caused by message overload, analyzes low‑level Windows message loops and async task queues, proposes a flexible priority‑queue scheduling framework, details its architecture, evaluation metrics, and demonstrates significant UI responsiveness improvements while outlining future enhancements.

client performancepriority-queueresource allocation
0 likes · 16 min read
How a Priority‑Queue Scheduler Supercharged Client Performance
ITPUB
ITPUB
Nov 5, 2021 · Operations

Master Linux ‘at’ Command: Schedule One‑Time Tasks Easily

Learn how to install, configure, and use the Linux ‘at’ command to schedule one‑time tasks, including interactive entry, piping commands, time expressions, viewing and removing jobs, and comparing it with cron for efficient, non‑recurring automation.

Linuxat commandcron alternative
0 likes · 9 min read
Master Linux ‘at’ Command: Schedule One‑Time Tasks Easily
Liangxu Linux
Liangxu Linux
Oct 28, 2021 · Operations

Master Linux ‘at’ Command: Schedule One‑Time Tasks Easily

This guide explains how to install, configure, and use the Linux at command for one‑off task scheduling, covering interactive and non‑interactive usage, time expressions, job management with atq/atrm, and differences from cron, all with practical code examples.

LinuxShellat command
0 likes · 8 min read
Master Linux ‘at’ Command: Schedule One‑Time Tasks Easily
Java High-Performance Architecture
Java High-Performance Architecture
Oct 12, 2021 · Big Data

Unpacking the Core Technologies Behind Modern Big Data Platforms

This article breaks down a typical big data platform architecture into its four layers—data collection, storage and analysis, sharing, and real‑time computation—detailing the essential tools such as Flume, HDFS, Hive, Spark, DataX, and task scheduling systems that enable scalable, low‑latency data processing and delivery.

DataXHadoopSpark
0 likes · 8 min read
Unpacking the Core Technologies Behind Modern Big Data Platforms
DataFunTalk
DataFunTalk
Oct 3, 2021 · Artificial Intelligence

Human‑Machine Coupling in Residential Services: AI‑Driven Quality Improvement at Beike

This article examines how Beike, a leading residential service platform, leverages human‑machine coupling across five AI integration levels to precisely characterize, control, and enhance service quality, using classification‑elevation‑allocation models, feedback‑based control, task scheduling optimization, and an intelligent training ground powered by a custom pre‑trained model.

AIHuman-Machine InteractionResidential Services
0 likes · 17 min read
Human‑Machine Coupling in Residential Services: AI‑Driven Quality Improvement at Beike
MaGe Linux Operations
MaGe Linux Operations
Oct 2, 2021 · Operations

Master Python Scheduling: 10 Practical Ways to Run Periodic Tasks

This comprehensive guide explores ten Python techniques for implementing periodic tasks—from simple while‑loop sleeps and the Timeloop library to advanced frameworks like APScheduler, Celery, and Apache Airflow—providing code samples, advantages, limitations, and architectural insights for reliable scheduling.

@AsyncAPSchedulerAirflow
0 likes · 27 min read
Master Python Scheduling: 10 Practical Ways to Run Periodic Tasks
OPPO Kernel Craftsman
OPPO Kernel Craftsman
Sep 17, 2021 · Fundamentals

Understanding FreeRTOS Task Scheduling and Inter‑Task Communication

This article explains how FreeRTOS treats tasks as the smallest scheduling unit, details the three phases of task scheduling, describes task states and transitions, and reviews the built‑in communication mechanisms such as semaphores, queues, notifications, and event groups.

FreeRTOSInter-task CommunicationRTOS
0 likes · 9 min read
Understanding FreeRTOS Task Scheduling and Inter‑Task Communication
Node Underground
Node Underground
Sep 10, 2021 · Backend Development

Master Distributed Task Scheduling with MidwayJS Task Component

This guide explains how to install, configure, and use the @midwayjs/task module for distributed and delayed task scheduling in Midway, covering Redis setup, code examples for cron jobs, local tasks, manual triggers, progress tracking, logging, and troubleshooting.

BackendBullMidwayJS
0 likes · 8 min read
Master Distributed Task Scheduling with MidwayJS Task Component
IT Architects Alliance
IT Architects Alliance
Sep 5, 2021 · Big Data

Big Data Platform Architecture: Core Layers, Technologies, and Practices

This article outlines a typical big data platform architecture, detailing its core layers—data acquisition, storage and analysis, sharing, application, real‑time computation, and task scheduling—while introducing key technologies such as Flume, HDFS, Hive, Spark, DataX, and monitoring considerations.

Data IngestionHadoopSpark
0 likes · 9 min read
Big Data Platform Architecture: Core Layers, Technologies, and Practices
Architect
Architect
Aug 29, 2021 · Backend Development

Design and Implementation of a DAG‑Based Task Orchestration Framework

This article explains how to design and implement a DAG‑based task orchestration framework in Java, covering graph representations, dependency management, executor integration, state tracking, and how to persist workflows and tasks in a relational database for platform‑level usage.

DAGExecutorJava
0 likes · 11 min read
Design and Implementation of a DAG‑Based Task Orchestration Framework
Code Ape Tech Column
Code Ape Tech Column
Aug 12, 2021 · Backend Development

Comparison of Distributed Task Scheduling Systems: Elastic-Job, Xxl-Job, and Quartz

This article examines common business scenarios requiring timed tasks, explains the differences between timer‑based and message‑driven approaches, and provides a detailed comparison of single‑machine and distributed scheduling frameworks—including Elastic‑Job, Xxl‑Job, and Quartz—highlighting their features, deployment models, and suitable use cases.

Elastic-Jobquartztask scheduling
0 likes · 11 min read
Comparison of Distributed Task Scheduling Systems: Elastic-Job, Xxl-Job, and Quartz
ITFLY8 Architecture Home
ITFLY8 Architecture Home
Aug 3, 2021 · Big Data

How Hera Transforms Vipshop’s Data Service for Scalable E‑Commerce Analytics

This article explains how Vipshop built the Hera data service since 2019 to provide a unified API for warehouse access, detailing its background, architecture, core features such as multi‑engine queries, adaptive execution, custom Lisp syntax, task scheduling, metrics collection, and performance gains for both B‑to‑B and B‑to‑C workloads.

Data ServiceLispSQL
0 likes · 21 min read
How Hera Transforms Vipshop’s Data Service for Scalable E‑Commerce Analytics
NetEase Smart Enterprise Tech+
NetEase Smart Enterprise Tech+
Jul 20, 2021 · Backend Development

How NetEase Cloud Accelerates Video Transcoding with Slice‑Based Parallelism

NetEase Cloud’s video transcoding service boosts processing speed by combining hardware acceleration, custom codecs, AMD EPYC servers, and a slice‑based parallel transcoding pipeline, while optimizing cluster task scheduling and handling straggler issues to achieve significant performance gains across large‑scale media workloads.

Distributed Processinghardware-accelerationslice transcoding
0 likes · 16 min read
How NetEase Cloud Accelerates Video Transcoding with Slice‑Based Parallelism
IT Architects Alliance
IT Architects Alliance
Jul 13, 2021 · Backend Development

Design and Implementation of a DAG‑Based Task Scheduling Framework

This article explains how to build a task‑orchestration framework using directed acyclic graphs (DAG), covering graph representations, Java data structures, dependency management, concurrent execution with thread pools, and persisting workflow state to a relational database for platform‑level use.

DAGJavatask scheduling
0 likes · 11 min read
Design and Implementation of a DAG‑Based Task Scheduling Framework
DataFunTalk
DataFunTalk
May 2, 2021 · Big Data

Continuous Optimization and Practice of Flink at Kuaishou

This article presents Kuaishou's comprehensive engineering practices for improving Flink's stability, task startup latency, and SQL performance, including high‑availability Kafka connectors, fault‑recovery mechanisms, I/O reductions, asynchronous job upgrades, aggregation optimizations, and future resource‑utilization plans.

FlinkKafkaOptimization
0 likes · 10 min read
Continuous Optimization and Practice of Flink at Kuaishou
Tencent Cloud Developer
Tencent Cloud Developer
Mar 31, 2021 · Backend Development

Design and Implementation of a Distributed Timer Service at Tencent

The article details Tencent’s design and implementation of a distributed timer service—using a multi‑level time‑wheel stored in a KV system, a scheduler daemon, broker, and notifier—to support reliable, low‑latency delayed tasks such as order closure and SMS activation, while addressing isolation, rate limiting, disaster recovery, and delivery guarantees.

KV storageRate Limitingdistributed timer
0 likes · 15 min read
Design and Implementation of a Distributed Timer Service at Tencent
Xueersi Online School Tech Team
Xueersi Online School Tech Team
Mar 26, 2021 · Fundamentals

Design Patterns and SOLID Principles for Building a Message Sending Service

This article explains how to apply classic design patterns and the six SOLID principles—Liskov Substitution, Single Responsibility, Dependency Inversion, Interface Segregation, Law of Demeter, and Open‑Closed—to design a maintainable, extensible message‑sending system with task scheduling and dynamic provider configuration.

BackendDesign PatternsPHP
0 likes · 17 min read
Design Patterns and SOLID Principles for Building a Message Sending Service
Liangxu Linux
Liangxu Linux
Feb 17, 2021 · Operations

Mastering Zeit: Install and Schedule Tasks Graphically on Ubuntu

This guide explains how to install the open‑source Zeit tool on Ubuntu 20.04, launch its graphical interface, and use it to create both one‑time and recurring scheduled tasks via the at and crontab back‑ends, complete with command examples and screenshots.

CronLinuxUbuntu
0 likes · 4 min read
Mastering Zeit: Install and Schedule Tasks Graphically on Ubuntu
360 Tech Engineering
360 Tech Engineering
Jan 7, 2021 · Big Data

Overview of the Qirin Big Data Platform Architecture and Core Modules

The article introduces the Qirin big data platform—a one‑stop solution covering resource management, metadata, data ingestion, task development, interactive querying, and self‑service analysis—detailing its modular architecture, typical processing workflow, and future development plans for enterprise‑wide data services.

Data Ingestionbig datadata platform
0 likes · 11 min read
Overview of the Qirin Big Data Platform Architecture and Core Modules
High Availability Architecture
High Availability Architecture
Dec 16, 2020 · Backend Development

Implementing Task Scheduling Dependencies and Workflow with Go and DAG

This article explains the concepts of task scheduling dependencies and workflow, introduces graph theory basics such as vertices, edges, and DAGs, and provides a complete Go implementation—including graph structures, BFS traversal, topological sorting, and concurrent execution—to efficiently manage dependent tasks in distributed systems.

ConcurrencyDAGGo
0 likes · 10 min read
Implementing Task Scheduling Dependencies and Workflow with Go and DAG
Qunar Tech Salon
Qunar Tech Salon
Nov 19, 2020 · Databases

Automated Migration Platform for Qunar DBA: Architecture, Implementation, and Outcomes

This article describes Qunar's DBA department automated migration platform, detailing its motivation, overall architecture, task pool and templates, customizable web‑based workflow, scheduling, execution queue, tooling, and the significant efficiency and reliability gains achieved across numerous database migration scenarios.

DBA toolsDatabase AutomationPython
0 likes · 10 min read
Automated Migration Platform for Qunar DBA: Architecture, Implementation, and Outcomes
DataFunTalk
DataFunTalk
Nov 8, 2020 · Backend Development

Design and Optimization of an In-Memory Search Engine

This article shares the author's exploration of in‑memory search engine design, covering system understanding, core architecture, thread and task models, intersection algorithms, lookup optimizations, and componentization, aiming to fill the scarce documentation on memory‑based retrieval engines.

IndexingQuery Processingin-memory search
0 likes · 48 min read
Design and Optimization of an In-Memory Search Engine
JavaEdge
JavaEdge
Oct 30, 2020 · Backend Development

How Netty’s EventLoop Thread Model Powers High‑Performance Networking

This article explains Netty's thread model, covering the evolution from simple Thread usage to Executor‑based pools, the design of the EventLoop interface, task scheduling mechanisms, differences between Netty 3 and Netty 4, and how thread allocation and ThreadLocal affect performance and scalability.

EventLoopJavaNetty
0 likes · 11 min read
How Netty’s EventLoop Thread Model Powers High‑Performance Networking
Xianyu Technology
Xianyu Technology
Aug 19, 2020 · Mobile Development

Optimizing Xianyu Android App Cold Start: Cutting Launch Time by Half

By establishing measurable standards, profiling the launch flow, and applying task‑governance techniques—delaying, shrinking and splitting blocking tasks—plus home‑page shortcuts like ad pre‑fetch, background view creation and SharedPreferences caching, Xianyu’s Android cold‑start on low‑end phones dropped from about ten seconds to under five, with the first screen in ~1.3 seconds and full launch in 4.5 seconds.

AndroidMobile DevelopmentPerformance Optimization
0 likes · 10 min read
Optimizing Xianyu Android App Cold Start: Cutting Launch Time by Half
Sohu Tech Products
Sohu Tech Products
Jul 8, 2020 · Big Data

Optimizing Workflow in Data Warehouse Construction: A Layered Task‑Instance Approach

The article analyzes data‑warehouse workflow scenarios, explains core concepts such as OLAP, multidimensional modeling and layer architecture, reviews existing workflow engines like Azkaban, Oozie and Airflow, and proposes a task‑and‑instance layered optimization that simplifies dependency configuration, improves collaboration, and supports complex scheduling in modern big‑data environments.

ETLbig datadependency management
0 likes · 21 min read
Optimizing Workflow in Data Warehouse Construction: A Layered Task‑Instance Approach
Full-Stack Internet Architecture
Full-Stack Internet Architecture
Jun 20, 2020 · Fundamentals

Applying the 5Whys Method to Diagnose and Resolve Workplace Issues

The article illustrates how the 5Whys root‑cause analysis can turn everyday workplace conflicts—like missed deadlines and poor communication—into actionable improvement plans by repeatedly asking why, encouraging systematic task scheduling, and fostering a habit of deeper inquiry for lasting productivity gains.

5WhysMobile Developmentcommunication
0 likes · 9 min read
Applying the 5Whys Method to Diagnose and Resolve Workplace Issues
Big Data Technology Architecture
Big Data Technology Architecture
Jun 11, 2020 · Big Data

Optimizing Workflow in Data Warehouse Construction

This article analyzes workflow scenarios in data warehouse construction, proposes an optimization scheme that abstracts workflow nodes into task and instance layers, and demonstrates how task attributes and generation rules can improve configurability, dependency management, and collaborative development for large‑scale data warehouse projects.

ETLbig datadependency management
0 likes · 19 min read
Optimizing Workflow in Data Warehouse Construction
DataFunTalk
DataFunTalk
Jun 6, 2020 · Big Data

Optimizing Workflow in Data Warehouse Construction: A Task‑Instance Layered Approach

The article analyzes workflow scenarios in data‑warehouse projects, proposes a two‑level model that abstracts workflow nodes into tasks and instances, defines period and dependency attributes, and presents generation rules that simplify configuration, improve collaboration, and support complex data‑processing schedules in modern big‑data environments.

ETLdata warehousedependency management
0 likes · 19 min read
Optimizing Workflow in Data Warehouse Construction: A Task‑Instance Layered Approach
Tencent Cloud Developer
Tencent Cloud Developer
Apr 29, 2020 · Cloud Computing

Large-Scale Task Scheduling Architecture of Tencent Meeting and VStation

The talk explains how Tencent’s self‑developed VStation scheduler, integrated with TKE and using a hybrid sharding‑plus‑master‑worker architecture, enabled Tencent Meeting to scale to over 100 000 hosts and one million CPU cores, cutting provisioning time to under ten seconds while handling thousands of tasks per minute through DAG‑driven automation and fault‑tolerant mechanisms.

Tencent MeetingVStationdistributed systems
0 likes · 24 min read
Large-Scale Task Scheduling Architecture of Tencent Meeting and VStation
Laravel Tech Community
Laravel Tech Community
Apr 18, 2020 · Backend Development

Master Laravel Task Scheduling: From Cron Setup to Advanced Constraints

This guide explains how to replace per‑task Cron entries with Laravel's unified scheduler, showing how to configure a single Cron line, define schedules in app/Console/Kernel.php using closures, invokable objects, Artisan commands, queue jobs, shell commands, and how to fine‑tune frequency, time windows, environment, timezone, overlapping, single‑server execution, background processing, maintenance mode, output handling, hooks, and URL pings.

ArtisanCronLaravel
0 likes · 13 min read
Master Laravel Task Scheduling: From Cron Setup to Advanced Constraints
Youzan Coder
Youzan Coder
Mar 11, 2020 · Backend Development

Youzan Task Scheduling Platform (TSP): Design, Implementation, and Future Roadmap

Youzan’s Task Scheduling Platform (TSP) unifies its legacy cron and timeout systems into a modular, extensible framework that supports both timed and delayed tasks, offering per‑task rate limiting, sharding, isolation, retry policies, and a rich SDK, while its roadmap adds end‑to‑end monitoring, workflow orchestration, domain‑level clustering, transactional messaging, and dynamic task registration.

BackendRate LimitingTSP
0 likes · 14 min read
Youzan Task Scheduling Platform (TSP): Design, Implementation, and Future Roadmap
Alibaba Cloud Developer
Alibaba Cloud Developer
Feb 28, 2020 · Mobile Development

How Personalized Startup Task Scheduling Cuts Android Launch Time by 0.8 s

This article describes how Alibaba's HandCat team analyzed the growing startup latency of their Android app, identified static initialization bottlenecks, and implemented a data‑driven, per‑user and per‑device task orchestration using AOP instrumentation and algorithmic scheduling, achieving up to 1.6 s faster launches on low‑end devices.

AOP instrumentationPerformancealgorithmic scheduling
0 likes · 15 min read
How Personalized Startup Task Scheduling Cuts Android Launch Time by 0.8 s
ITPUB
ITPUB
Feb 26, 2020 · Backend Development

Why XXL‑JOB Is the Lightweight Distributed Scheduler Used by 290+ Companies

XXL‑JOB is an open‑source, lightweight distributed task scheduling platform adopted by over 290 enterprises, offering 35 features, a decoupled scheduling‑center and executor architecture, and a thriving GitHub community with more than 12 K stars and 5 K forks.

BackendJavaXXL-JOB
0 likes · 5 min read
Why XXL‑JOB Is the Lightweight Distributed Scheduler Used by 290+ Companies
Alibaba Cloud Native
Alibaba Cloud Native
Jan 22, 2020 · Backend Development

Mastering Microservices: RPC, Service Discovery, Config, Scheduling & More

This comprehensive guide explains the benefits of microservices and walks through core building blocks such as RPC, service discovery, configuration management, task scheduling, distributed locking, unified monitoring, caching strategies, message queues, distributed transactions, CAP theory, seckill handling, Docker isolation, and modern CI/CD deployment pipelines.

Backendconfiguration managementdistributed lock
0 likes · 24 min read
Mastering Microservices: RPC, Service Discovery, Config, Scheduling & More
58 Tech
58 Tech
Jan 6, 2020 · Big Data

Design and Architecture of the 58DP Big Data Platform Task Scheduling System

The article presents a comprehensive overview of the 58DP big data platform's task scheduling system, detailing its background, architecture, high‑availability design, slot‑based resource management, scheduling models, task lifecycle, priority rules, dependency handling, failure recovery, and future enhancements.

big datadistributed systemresource management
0 likes · 14 min read
Design and Architecture of the 58DP Big Data Platform Task Scheduling System
HomeTech
HomeTech
Dec 12, 2019 · Big Data

Architecture and Design of the Home Data Integration Governance Platform

The article describes the background, architecture, and design principles of a unified big‑data scheduling and data‑exchange platform, detailing its data ingestion “direct‑train”, centralized scheduling engine, and DataX‑based data‑exchange components along with monitoring, alerting, and security features.

Data IntegrationDataXPlatform Architecture
0 likes · 7 min read
Architecture and Design of the Home Data Integration Governance Platform
21CTO
21CTO
Oct 1, 2019 · Backend Development

How Ant Financial Scales Payments with Distributed Microservices and Database Sharding

This article explains Ant Financial's practical implementation of a distributed architecture—including micro‑service migration, modular development, database vertical and horizontal sharding, high‑availability mechanisms, task‑scheduling platforms, gray‑release strategies, and full‑link stress testing—to achieve reliable, scalable payment processing.

Distributed Architecturecloud-nativedatabase sharding
0 likes · 8 min read
How Ant Financial Scales Payments with Distributed Microservices and Database Sharding
Java Captain
Java Captain
May 6, 2019 · Backend Development

Introduction to Spring Boot with Code Examples

This article provides a comprehensive tutorial on Spring Boot, covering its purpose, key advantages, project setup with Maven, essential configuration files, integration of JdbcTemplate, JPA, MyBatis, JSP, AOP, and task scheduling, all illustrated with complete Java code snippets.

AOPJPAJava
0 likes · 12 min read
Introduction to Spring Boot with Code Examples
58 Tech
58 Tech
Apr 4, 2019 · Operations

Redesign of the Signal System for Task Scheduling and Dependency Management

This article explains the shortcomings of the legacy signal design in a scheduling platform, outlines four major dependency problems, and presents a newly engineered signal system with modular functions, instance ID generation, competitive priority rules, and state management to reliably support complex cross‑period and parallel job dependencies.

operationspriority handlingsignal system
0 likes · 9 min read
Redesign of the Signal System for Task Scheduling and Dependency Management
Alibaba Cloud Developer
Alibaba Cloud Developer
Feb 1, 2019 · Artificial Intelligence

How an Automatic Pipeline Framework Supercharges AI Inference in Retail Surveillance

This article explains how Alibaba's automatic task‑pipeline system transforms deep‑learning inference for retail video streams by decoupling model execution from scheduling, using Python‑based pipelines, high‑performance shared memory, and robust fault‑tolerance, achieving up to 13% faster processing and double the camera capacity.

AI PipelinePerformance OptimizationPython
0 likes · 22 min read
How an Automatic Pipeline Framework Supercharges AI Inference in Retail Surveillance
Youzan Coder
Youzan Coder
Jul 20, 2018 · Big Data

How Youzan Built a Scalable Big Data Development Platform (DP)

This article details the design, architecture, and operational experience of Youzan's Data Platform (DP), covering its scheduling, data‑sync, service, and monitoring modules, the custom Airflow‑based task scheduler, current production metrics, supported task types, and future improvement plans.

Airflowbig datadata platform
0 likes · 12 min read
How Youzan Built a Scalable Big Data Development Platform (DP)
Alibaba Cloud Developer
Alibaba Cloud Developer
Apr 12, 2018 · Backend Development

How Alibaba’s Cainiao Scales a Lightweight Timer Engine for Billions of Packages

Facing the challenge of processing over 100 million daily parcels, Alibaba’s Cainiao designed a lightweight, time‑wheel‑based scheduling engine that decouples task storage from timing, leverages partitioned task chains, master‑driven node IDs, and cluster‑wide soft‑load balancing to achieve scalable, fault‑tolerant timer processing.

backend engineeringcluster-managementtask scheduling
0 likes · 12 min read
How Alibaba’s Cainiao Scales a Lightweight Timer Engine for Billions of Packages
Efficient Ops
Efficient Ops
Dec 19, 2017 · Databases

How ZanDB Automates MySQL Operations at Scale: A Deep Dive

ZanDB is Youzan's comprehensive MySQL automation platform that standardizes OS and database configurations, introduces a web‑based UI, task scheduling, backup monitoring, host and instance management, log analysis, metadata services, and high‑availability features to dramatically reduce manual DBA work and improve reliability.

Backup MonitoringMySQL automationZanDB
0 likes · 15 min read
How ZanDB Automates MySQL Operations at Scale: A Deep Dive
Yuewen Technology
Yuewen Technology
Nov 24, 2017 · Backend Development

How to Build a Scalable Distributed Task Scheduler from Scratch

This article outlines the shortcomings of using crontab for large‑scale job execution, defines the requirements for a custom distributed scheduler, describes its three‑component architecture (trigger, monitor, management), and details key technical solutions such as process isolation, distributed locking, and log aggregation.

Rediscron replacementdistributed systems
0 likes · 12 min read
How to Build a Scalable Distributed Task Scheduler from Scratch
ITPUB
ITPUB
Oct 18, 2017 · Databases

How ZanDB Automates MySQL Backup, Task Scheduling, and Instance Management

This article outlines ZanDB's approach to standardizing MySQL environments, implementing a real‑time backup monitoring system, and building a comprehensive automation platform that includes task scheduling, host and instance management, log handling, metadata tracking, and daily maintenance to streamline DBA operations.

Database ManagementMySQLZanDB
0 likes · 11 min read
How ZanDB Automates MySQL Backup, Task Scheduling, and Instance Management
BiCaiJia Technology Team
BiCaiJia Technology Team
Oct 14, 2017 · Backend Development

Mastering Quartz: How to Build a Page‑Based Task Scheduler

This tutorial walks through creating a web‑based task scheduling interface with Quartz, covering configuration, job definition, trigger setup, and UI integration to manage scheduled jobs through a visual page, including database persistence and real‑time status monitoring.

Web UIbackend developmentquartz
0 likes · 1 min read
Mastering Quartz: How to Build a Page‑Based Task Scheduler
WeChat Backend Team
WeChat Backend Team
May 7, 2017 · Backend Development

How WeChat’s MQ 2.0 Redefined Asynchronous Queues for Massive Scale

This article explains the design and improvements of WeChat's MQ 2.0 asynchronous queue, covering its cross‑machine consumption model, enhanced task scheduling, MapReduce‑style processing, stream tasks, and robust overload protection that together enable high‑performance, resilient backend services.

asynchronous-processingbackend architectureload balancing
0 likes · 13 min read
How WeChat’s MQ 2.0 Redefined Asynchronous Queues for Massive Scale