BestHub
Sign in
Tagged articles
198 articles
Page 2 of 2
Cognitive Technology Team
Cognitive Technology Team
Oct 16, 2022 · Backend Development

Understanding ScheduledThreadPoolExecutor: Task Types, Configuration, and Common Pitfalls

This article explains the different delay and periodic task types supported by Java's ScheduledThreadPoolExecutor, details its constructor parameters and default settings, and highlights common pitfalls such as exception loss, inaccurate scheduling, and improper core pool size configuration.

Exception HandlingJavaScheduledThreadPoolExecutor
0 likes · 5 min read
Understanding ScheduledThreadPoolExecutor: Task Types, Configuration, and Common Pitfalls
IT Services Circle
IT Services Circle
Oct 4, 2022 · Backend Development

Creating an Auto‑Register Spring Boot Starter for XXL‑Job Executors and JobHandlers

This article explains how to build a Spring Boot starter that automatically registers XXL‑Job executors and job handlers by logging into the admin center, invoking the necessary REST APIs, and using custom annotations to capture job metadata, eliminating manual configuration for large numbers of scheduled tasks.

StarterXXL-JOBauto registration
0 likes · 12 min read
Creating an Auto‑Register Spring Boot Starter for XXL‑Job Executors and JobHandlers
ITPUB
ITPUB
Sep 24, 2022 · Operations

How Alibaba Cloud Log Service Scales Billion‑Task Scheduling: Design and Practice

This article explains how Alibaba Cloud Log Service implements a billion‑scale task scheduling framework for its observability platform, covering background, task types, design goals, architecture, key design points, and practical examples such as aggregation jobs and various scheduling scenarios.

Log Servicelarge scalemaster-worker
0 likes · 22 min read
How Alibaba Cloud Log Service Scales Billion‑Task Scheduling: Design and Practice
ITFLY8 Architecture Home
ITFLY8 Architecture Home
Sep 13, 2022 · Backend Development

Choosing the Right Java Scheduling Framework: Timer, Quartz, Elastic-Job, X-Job Compared

This article examines common business scenarios that require timed execution, explains why scheduled tasks are essential, compares standalone and distributed Java scheduling frameworks—including Timer, ScheduledExecutorService, Spring, Quartz, TBSchedule, Elastic-Job, Saturn, and XXL-Job—and provides guidance on selecting the most suitable solution based on scalability, reliability, and operational needs.

Backend DevelopmentDistributed SystemsJava
0 likes · 14 min read
Choosing the Right Java Scheduling Framework: Timer, Quartz, Elastic-Job, X-Job Compared
Alibaba Cloud Native
Alibaba Cloud Native
Sep 1, 2022 · Operations

Which Scheduling Solution Fits Your Enterprise? Crontab, Spring Task, ElasticJob, XXLJob or Serverless

This article compares five popular enterprise scheduling solutions—Crontab, Spring Task, ElasticJob, XXLJob, and Serverless Job—by outlining their goals, usage patterns, implementation details, and common pain points, helping architects choose the most suitable option for cloud‑native environments.

Spring Taskcrontabelasticjob
0 likes · 18 min read
Which Scheduling Solution Fits Your Enterprise? Crontab, Spring Task, ElasticJob, XXLJob or Serverless
Alipay Experience Technology
Alipay Experience Technology
Aug 22, 2022 · Mobile Development

How Alipay Engineers Built a Fine‑Grained Scheduling System for Mobile Apps

This article details Alipay's evolution from basic thread pools to a sophisticated, multi‑layered scheduling framework that balances UI responsiveness, task prioritization, and resource control across Android devices, while outlining the technical challenges and future directions of fine‑grained scheduling.

AndroidPerformance Optimizationtask scheduling
0 likes · 13 min read
How Alipay Engineers Built a Fine‑Grained Scheduling System for Mobile Apps
Baidu App Technology
Baidu App Technology
Aug 19, 2022 · Mobile Development

Baidu App Low-End Device Startup Performance Optimization: A Comprehensive Guide

Baidu’s comprehensive low‑end device startup optimization—using a scoring‑based observation system, TTI metrics, automated degradation prevention, high‑performance tools such as UniKV and ABTest lock fixes, and an intelligent scheduling framework—cut cold‑start TTI by over 40% on Android and 30%‑plus on iOS.

Android optimizationdegradation preventionios-optimization
0 likes · 19 min read
Baidu App Low-End Device Startup Performance Optimization: A Comprehensive Guide
360 Quality & Efficiency
360 Quality & Efficiency
Jul 15, 2022 · Backend Development

Using APScheduler for Asynchronous Task Scheduling in Flask

This article introduces the Python APScheduler framework, explains its four core components, shows how to install it, and provides a step‑by‑step guide for integrating background task scheduling into a Flask application with appropriate scheduler, job store, executor, and trigger selections.

APSchedulerAsyncBackgroundScheduler
0 likes · 6 min read
Using APScheduler for Asynchronous Task Scheduling in Flask
Baidu Geek Talk
Baidu Geek Talk
Jun 28, 2022 · Artificial Intelligence

Intelligent Test Execution Practices: Risk‑Based Manual Test Recommendation, Parallel‑Coverage Traffic Filtering, Smart Build, and Priority‑Based Task Scheduling

The article covers intelligent test execution practices: risk‑based manual test recommendation, parallel‑coverage traffic filtering, smart build, priority‑based task scheduling, and UI automation self‑healing, describing methods, algorithms, and results that reduce test volume, speed up regression, and improve stability.

UI self-healingsmart buildtask scheduling
0 likes · 12 min read
Intelligent Test Execution Practices: Risk‑Based Manual Test Recommendation, Parallel‑Coverage Traffic Filtering, Smart Build, and Priority‑Based Task Scheduling
SQB Blog
SQB Blog
Jun 24, 2022 · Fundamentals

Unlocking Embedded RTOS: A Deep Dive into Multi‑Task Scheduling, IPC, and Chip Porting

This comprehensive guide explores the fundamentals of embedded real‑time operating systems, covering instruction set architecture, hardware‑software ecosystems, multi‑task scheduling algorithms, inter‑process communication primitives, software timers, and concrete RISC‑V and Cortex‑M porting implementations with Rust and assembly examples.

AssemblyRTOSRust
0 likes · 65 min read
Unlocking Embedded RTOS: A Deep Dive into Multi‑Task Scheduling, IPC, and Chip Porting
Laravel Tech Community
Laravel Tech Community
May 30, 2022 · Operations

Understanding and Using crontab for Task Scheduling on Linux

This guide explains how to install, start, and stop the crontab service, configure global and user-specific cron directories, write crontab entries with proper syntax, and apply advanced techniques such as output redirection, nohup, background execution, and date-based log naming for reliable Linux task automation.

Cron JobsLinuxcrontab
0 likes · 9 min read
Understanding and Using crontab for Task Scheduling on Linux
Code Ape Tech Column
Code Ape Tech Column
Apr 27, 2022 · Backend Development

Understanding Task Scheduling: Quartz, Distributed Locks, ElasticJob‑Lite, XXL‑JOB and a Custom Solution

This article explains the core concepts, architectures and trade‑offs of several Java task‑scheduling solutions—including Quartz, Redis/Zookeeper distributed locks, ElasticJob‑Lite, XXL‑JOB and a self‑built scheduler—while providing code examples and practical guidance for building reliable, scalable job execution systems.

JavaQuartzXXL-JOB
0 likes · 17 min read
Understanding Task Scheduling: Quartz, Distributed Locks, ElasticJob‑Lite, XXL‑JOB and a Custom Solution
DataFunTalk
DataFunTalk
Apr 12, 2022 · Big Data

Kuaishou Big Data Task Scheduling System: Architecture, Challenges, and Key Technologies

This article presents Kuaishou's large‑scale big‑data task scheduling system, describing its evolution from Airflow to the self‑developed Kwaiflow, the performance and reliability challenges of handling hundreds of thousands of tasks, and the design decisions that achieve low latency, high availability, and strong open capabilities.

Distributed SystemsKuaishouKwaiflow
0 likes · 22 min read
Kuaishou Big Data Task Scheduling System: Architecture, Challenges, and Key Technologies
IT Services Circle
IT Services Circle
Apr 6, 2022 · Backend Development

Getting Started with XXL‑Job: Installation, Configuration, and Developing Scheduled Tasks

This tutorial walks through the entire lifecycle of using the XXL‑Job distributed scheduling framework—including a brief comparison with ElasticJob, downloading and running the admin console, configuring the MySQL database, setting up a SpringBoot project, adding dependencies, writing Bean‑based and GLUE tasks, registering the executor, and finally creating and monitoring scheduled jobs via the web UI.

DistributedJavaSpringBoot
0 likes · 13 min read
Getting Started with XXL‑Job: Installation, Configuration, and Developing Scheduled Tasks
Ziru Technology
Ziru Technology
Apr 1, 2022 · Fundamentals

How Kafka’s Hierarchical Timing Wheel Optimizes Task Scheduling

This article explains the time‑wheel algorithm, from its basic circular‑buffer principle to simple, round‑based, and hierarchical variants, and shows how Kafka implements a multi‑level timing wheel to achieve efficient, low‑memory delayed task execution.

Kafkabackend algorithmshierarchical timer
0 likes · 13 min read
How Kafka’s Hierarchical Timing Wheel Optimizes Task Scheduling
Java Backend Technology
Java Backend Technology
Mar 26, 2022 · Backend Development

XXL-JOB Mastery: A Step-by-Step Spring Boot Guide to Distributed Scheduling

This tutorial walks you through installing and configuring the open‑source XXL‑JOB scheduler, comparing it with ElasticJob, setting up the admin console, creating a Spring Boot project, adding the necessary dependencies, configuring database and logging, and implementing scheduled tasks using Bean, Method, and GLUE modes, complete with code examples and screenshots.

Distributed SystemsXXL-JOBtask scheduling
0 likes · 15 min read
XXL-JOB Mastery: A Step-by-Step Spring Boot Guide to Distributed Scheduling
Sohu Tech Products
Sohu Tech Products
Mar 2, 2022 · Mobile Development

Designing a Robust Android App Startup Framework with Annotation Processing and Task Scheduling

This article explains how to build a high‑performance Android startup framework by collecting initialization tasks with custom annotations, generating code via annotation processors, injecting tasks into the application, and scheduling them using a DAG‑based algorithm that supports async execution, multi‑process, and priority handling.

AndroidAnnotation ProcessingKotlin
0 likes · 11 min read
Designing a Robust Android App Startup Framework with Annotation Processing and Task Scheduling
Alibaba Cloud Native
Alibaba Cloud Native
Jan 25, 2022 · Operations

How SchedulerX Enables Cloud‑Native Distributed Task Scheduling and Visual Management

This article explains the core concepts of SchedulerX, a cloud‑native distributed task scheduling platform, covering its resource model, visual control features, distributed batch processing capabilities, practical use‑case scenarios, and step‑by‑step integration with a SpringBoot application.

Batch ProcessingDistributed SystemsSchedulerX
0 likes · 10 min read
How SchedulerX Enables Cloud‑Native Distributed Task Scheduling and Visual Management
ByteDance SE Lab
ByteDance SE Lab
Dec 31, 2021 · Mobile Development

How to Slash iOS App Startup Time: Strategies from the Watermelon App

This article details the Watermelon iOS app's comprehensive startup optimization, covering launch phase definitions, metric design, task scheduling, code instrumentation, thread management, rendering and network improvements, as well as monitoring and anti‑regression measures to consistently reduce launch latency.

iOSnetwork optimizationstartup optimization
0 likes · 24 min read
How to Slash iOS App Startup Time: Strategies from the Watermelon App
ByteDance Terminal Technology
ByteDance Terminal Technology
Dec 28, 2021 · Mobile Development

Analyzing Gradle’s Scheduling Mechanism to Optimize Android Component Publishing

This article investigates why large Android projects experience extremely slow AAR publishing, reveals that memory is not the main bottleneck, examines Gradle’s core scheduling, Worker API, lock contention, and measurement inaccuracies, and proposes disabling Worker API to achieve up to fifteen‑fold build speed improvements.

AndroidBuild PerformanceGradle
0 likes · 20 min read
Analyzing Gradle’s Scheduling Mechanism to Optimize Android Component Publishing
Beike Product & Technology
Beike Product & Technology
Dec 23, 2021 · Frontend Development

How React Fiber’s Time‑Slicing Makes UI Updates Seamlessly Smooth

An in‑depth walkthrough of React’s Fiber architecture reveals how time‑slicing and a linked‑list Fiber tree replace the stack‑based reconciler of React 15, delivering smoother UI updates, priority‑based task scheduling, and interruptible rendering, complete with code examples, performance comparisons, and the underlying event‑loop mechanics.

FiberReactTime Slicing
0 likes · 12 min read
How React Fiber’s Time‑Slicing Makes UI Updates Seamlessly Smooth
Xiao Lou's Tech Notes
Xiao Lou's Tech Notes
Dec 16, 2021 · Backend Development

From Druid to MetaQ: A Developer’s Journey Through Middleware Mastery

This article chronicles a developer’s personal and technical evolution—from refactoring a lottery service with Druid, exploring Cobar sharding, diving deep into MetaQ’s messaging model, to designing custom task‑scheduling systems—highlighting lessons learned, architectural insights, and the enduring value of connecting the dots in software engineering.

BackendMessage Queuemiddleware
0 likes · 16 min read
From Druid to MetaQ: A Developer’s Journey Through Middleware Mastery
Tencent Cloud Developer
Tencent Cloud Developer
Dec 8, 2021 · Cloud Native

Using Tencent Cloud EKS Virtual Nodes to Solve CronJob Isolation and Scheduling Challenges

By offloading thousands of short‑lived CronJob pods to Tencent Cloud EKS serverless virtual nodes, Zuoyebang isolated them from online services, eliminated IP waste, achieved millisecond‑level parallel scheduling and sub‑3‑second startup, freed 10 % of cluster resources and cut scheduling costs by roughly 70 % while markedly improving cluster stability.

Cloud NativeCronJobKubernetes
0 likes · 10 min read
Using Tencent Cloud EKS Virtual Nodes to Solve CronJob Isolation and Scheduling Challenges
Tencent Qidian Tech Team
Tencent Qidian Tech Team
Dec 2, 2021 · Backend Development

How a Priority‑Queue Scheduler Supercharged Client Performance

This article examines client‑side performance bottlenecks caused by message overload, analyzes low‑level Windows message loops and async task queues, proposes a flexible priority‑queue scheduling framework, details its architecture, evaluation metrics, and demonstrates significant UI responsiveness improvements while outlining future enhancements.

client performancepriority-queueresource allocation
0 likes · 16 min read
How a Priority‑Queue Scheduler Supercharged Client Performance
ITPUB
ITPUB
Nov 5, 2021 · Operations

Master Linux ‘at’ Command: Schedule One‑Time Tasks Easily

Learn how to install, configure, and use the Linux ‘at’ command to schedule one‑time tasks, including interactive entry, piping commands, time expressions, viewing and removing jobs, and comparing it with cron for efficient, non‑recurring automation.

LinuxSystem Administrationat command
0 likes · 9 min read
Master Linux ‘at’ Command: Schedule One‑Time Tasks Easily
Liangxu Linux
Liangxu Linux
Oct 28, 2021 · Operations

Master Linux ‘at’ Command: Schedule One‑Time Tasks Easily

This guide explains how to install, configure, and use the Linux at command for one‑off task scheduling, covering interactive and non‑interactive usage, time expressions, job management with atq/atrm, and differences from cron, all with practical code examples.

LinuxShellat command
0 likes · 8 min read
Master Linux ‘at’ Command: Schedule One‑Time Tasks Easily
Java High-Performance Architecture
Java High-Performance Architecture
Oct 12, 2021 · Big Data

Unpacking the Core Technologies Behind Modern Big Data Platforms

This article breaks down a typical big data platform architecture into its four layers—data collection, storage and analysis, sharing, and real‑time computation—detailing the essential tools such as Flume, HDFS, Hive, Spark, DataX, and task scheduling systems that enable scalable, low‑latency data processing and delivery.

Big DataData ArchitectureDataX
0 likes · 8 min read
Unpacking the Core Technologies Behind Modern Big Data Platforms
DataFunTalk
DataFunTalk
Oct 3, 2021 · Artificial Intelligence

Human‑Machine Coupling in Residential Services: AI‑Driven Quality Improvement at Beike

This article examines how Beike, a leading residential service platform, leverages human‑machine coupling across five AI integration levels to precisely characterize, control, and enhance service quality, using classification‑elevation‑allocation models, feedback‑based control, task scheduling optimization, and an intelligent training ground powered by a custom pre‑trained model.

AIHuman-Machine InteractionResidential Services
0 likes · 17 min read
Human‑Machine Coupling in Residential Services: AI‑Driven Quality Improvement at Beike
MaGe Linux Operations
MaGe Linux Operations
Oct 2, 2021 · Operations

Master Python Scheduling: 10 Practical Ways to Run Periodic Tasks

This comprehensive guide explores ten Python techniques for implementing periodic tasks—from simple while‑loop sleeps and the Timeloop library to advanced frameworks like APScheduler, Celery, and Apache Airflow—providing code samples, advantages, limitations, and architectural insights for reliable scheduling.

APSchedulerAirflowAsync
0 likes · 27 min read
Master Python Scheduling: 10 Practical Ways to Run Periodic Tasks
OPPO Kernel Craftsman
OPPO Kernel Craftsman
Sep 17, 2021 · Fundamentals

Understanding FreeRTOS Task Scheduling and Inter‑Task Communication

This article explains how FreeRTOS treats tasks as the smallest scheduling unit, details the three phases of task scheduling, describes task states and transitions, and reviews the built‑in communication mechanisms such as semaphores, queues, notifications, and event groups.

FreeRTOSInter-task CommunicationRTOS
0 likes · 9 min read
Understanding FreeRTOS Task Scheduling and Inter‑Task Communication
Node Underground
Node Underground
Sep 10, 2021 · Backend Development

Master Distributed Task Scheduling with MidwayJS Task Component

This guide explains how to install, configure, and use the @midwayjs/task module for distributed and delayed task scheduling in Midway, covering Redis setup, code examples for cron jobs, local tasks, manual triggers, progress tracking, logging, and troubleshooting.

BackendBullMidwayJS
0 likes · 8 min read
Master Distributed Task Scheduling with MidwayJS Task Component
IT Architects Alliance
IT Architects Alliance
Sep 5, 2021 · Big Data

Big Data Platform Architecture: Core Layers, Technologies, and Practices

This article outlines a typical big data platform architecture, detailing its core layers—data acquisition, storage and analysis, sharing, application, real‑time computation, and task scheduling—while introducing key technologies such as Flume, HDFS, Hive, Spark, DataX, and monitoring considerations.

Big DataData PlatformHadoop
0 likes · 9 min read
Big Data Platform Architecture: Core Layers, Technologies, and Practices
Architect
Architect
Aug 29, 2021 · Backend Development

Design and Implementation of a DAG‑Based Task Orchestration Framework

This article explains how to design and implement a DAG‑based task orchestration framework in Java, covering graph representations, dependency management, executor integration, state tracking, and how to persist workflows and tasks in a relational database for platform‑level usage.

DAGExecutorJava
0 likes · 11 min read
Design and Implementation of a DAG‑Based Task Orchestration Framework
Code Ape Tech Column
Code Ape Tech Column
Aug 12, 2021 · Backend Development

Comparison of Distributed Task Scheduling Systems: Elastic-Job, Xxl-Job, and Quartz

This article examines common business scenarios requiring timed tasks, explains the differences between timer‑based and message‑driven approaches, and provides a detailed comparison of single‑machine and distributed scheduling frameworks—including Elastic‑Job, Xxl‑Job, and Quartz—highlighting their features, deployment models, and suitable use cases.

Elastic-JobQuartztask scheduling
0 likes · 11 min read
Comparison of Distributed Task Scheduling Systems: Elastic-Job, Xxl-Job, and Quartz
ITFLY8 Architecture Home
ITFLY8 Architecture Home
Aug 3, 2021 · Big Data

How Hera Transforms Vipshop’s Data Service for Scalable E‑Commerce Analytics

This article explains how Vipshop built the Hera data service since 2019 to provide a unified API for warehouse access, detailing its background, architecture, core features such as multi‑engine queries, adaptive execution, custom Lisp syntax, task scheduling, metrics collection, and performance gains for both B‑to‑B and B‑to‑C workloads.

Data ServiceDistributed SystemsLisp
0 likes · 21 min read
How Hera Transforms Vipshop’s Data Service for Scalable E‑Commerce Analytics
NetEase Smart Enterprise Tech+
NetEase Smart Enterprise Tech+
Jul 20, 2021 · Backend Development

How NetEase Cloud Accelerates Video Transcoding with Slice‑Based Parallelism

NetEase Cloud’s video transcoding service boosts processing speed by combining hardware acceleration, custom codecs, AMD EPYC servers, and a slice‑based parallel transcoding pipeline, while optimizing cluster task scheduling and handling straggler issues to achieve significant performance gains across large‑scale media workloads.

Distributed ProcessingHardware accelerationVideo Transcoding
0 likes · 16 min read
How NetEase Cloud Accelerates Video Transcoding with Slice‑Based Parallelism
IT Architects Alliance
IT Architects Alliance
Jul 13, 2021 · Backend Development

Design and Implementation of a DAG‑Based Task Scheduling Framework

This article explains how to build a task‑orchestration framework using directed acyclic graphs (DAG), covering graph representations, Java data structures, dependency management, concurrent execution with thread pools, and persisting workflow state to a relational database for platform‑level use.

DAGJavatask scheduling
0 likes · 11 min read
Design and Implementation of a DAG‑Based Task Scheduling Framework
DataFunTalk
DataFunTalk
May 2, 2021 · Big Data

Continuous Optimization and Practice of Flink at Kuaishou

This article presents Kuaishou's comprehensive engineering practices for improving Flink's stability, task startup latency, and SQL performance, including high‑availability Kafka connectors, fault‑recovery mechanisms, I/O reductions, asynchronous job upgrades, aggregation optimizations, and future resource‑utilization plans.

Big DataFlinkKafka
0 likes · 10 min read
Continuous Optimization and Practice of Flink at Kuaishou
Tencent Cloud Developer
Tencent Cloud Developer
Mar 31, 2021 · Backend Development

Design and Implementation of a Distributed Timer Service at Tencent

The article details Tencent’s design and implementation of a distributed timer service—using a multi‑level time‑wheel stored in a KV system, a scheduler daemon, broker, and notifier—to support reliable, low‑latency delayed tasks such as order closure and SMS activation, while addressing isolation, rate limiting, disaster recovery, and delivery guarantees.

KV storageTime Wheeldistributed timer
0 likes · 15 min read
Design and Implementation of a Distributed Timer Service at Tencent
Xueersi Online School Tech Team
Xueersi Online School Tech Team
Mar 26, 2021 · Fundamentals

Design Patterns and SOLID Principles for Building a Message Sending Service

This article explains how to apply classic design patterns and the six SOLID principles—Liskov Substitution, Single Responsibility, Dependency Inversion, Interface Segregation, Law of Demeter, and Open‑Closed—to design a maintainable, extensible message‑sending system with task scheduling and dynamic provider configuration.

BackendDesign PatternsPHP
0 likes · 17 min read
Design Patterns and SOLID Principles for Building a Message Sending Service
Liangxu Linux
Liangxu Linux
Feb 17, 2021 · Operations

Mastering Zeit: Install and Schedule Tasks Graphically on Ubuntu

This guide explains how to install the open‑source Zeit tool on Ubuntu 20.04, launch its graphical interface, and use it to create both one‑time and recurring scheduled tasks via the at and crontab back‑ends, complete with command examples and screenshots.

LinuxUbuntuZeit
0 likes · 4 min read
Mastering Zeit: Install and Schedule Tasks Graphically on Ubuntu
360 Tech Engineering
360 Tech Engineering
Jan 7, 2021 · Big Data

Overview of the Qirin Big Data Platform Architecture and Core Modules

The article introduces the Qirin big data platform—a one‑stop solution covering resource management, metadata, data ingestion, task development, interactive querying, and self‑service analysis—detailing its modular architecture, typical processing workflow, and future development plans for enterprise‑wide data services.

Big DataData PlatformResource Management
0 likes · 11 min read
Overview of the Qirin Big Data Platform Architecture and Core Modules
High Availability Architecture
High Availability Architecture
Dec 16, 2020 · Backend Development

Implementing Task Scheduling Dependencies and Workflow with Go and DAG

This article explains the concepts of task scheduling dependencies and workflow, introduces graph theory basics such as vertices, edges, and DAGs, and provides a complete Go implementation—including graph structures, BFS traversal, topological sorting, and concurrent execution—to efficiently manage dependent tasks in distributed systems.

DAGGoconcurrency
0 likes · 10 min read
Implementing Task Scheduling Dependencies and Workflow with Go and DAG
Qunar Tech Salon
Qunar Tech Salon
Nov 19, 2020 · Databases

Automated Migration Platform for Qunar DBA: Architecture, Implementation, and Outcomes

This article describes Qunar's DBA department automated migration platform, detailing its motivation, overall architecture, task pool and templates, customizable web‑based workflow, scheduling, execution queue, tooling, and the significant efficiency and reliability gains achieved across numerous database migration scenarios.

DBA toolsPythonSaltStack
0 likes · 10 min read
Automated Migration Platform for Qunar DBA: Architecture, Implementation, and Outcomes
DataFunTalk
DataFunTalk
Nov 8, 2020 · Backend Development

Design and Optimization of an In-Memory Search Engine

This article shares the author's exploration of in‑memory search engine design, covering system understanding, core architecture, thread and task models, intersection algorithms, lookup optimizations, and componentization, aiming to fill the scarce documentation on memory‑based retrieval engines.

Query ProcessingThread Modelin-memory search
0 likes · 48 min read
Design and Optimization of an In-Memory Search Engine
JavaEdge
JavaEdge
Oct 30, 2020 · Backend Development

How Netty’s EventLoop Thread Model Powers High‑Performance Networking

This article explains Netty's thread model, covering the evolution from simple Thread usage to Executor‑based pools, the design of the EventLoop interface, task scheduling mechanisms, differences between Netty 3 and Netty 4, and how thread allocation and ThreadLocal affect performance and scalability.

Backend DevelopmentEventLoopJava
0 likes · 11 min read
How Netty’s EventLoop Thread Model Powers High‑Performance Networking
Xianyu Technology
Xianyu Technology
Aug 19, 2020 · Mobile Development

Optimizing Xianyu Android App Cold Start: Cutting Launch Time by Half

By establishing measurable standards, profiling the launch flow, and applying task‑governance techniques—delaying, shrinking and splitting blocking tasks—plus home‑page shortcuts like ad pre‑fetch, background view creation and SharedPreferences caching, Xianyu’s Android cold‑start on low‑end phones dropped from about ten seconds to under five, with the first screen in ~1.3 seconds and full launch in 4.5 seconds.

AndroidMobile DevelopmentPerformance Optimization
0 likes · 10 min read
Optimizing Xianyu Android App Cold Start: Cutting Launch Time by Half
Sohu Tech Products
Sohu Tech Products
Jul 8, 2020 · Big Data

Optimizing Workflow in Data Warehouse Construction: A Layered Task‑Instance Approach

The article analyzes data‑warehouse workflow scenarios, explains core concepts such as OLAP, multidimensional modeling and layer architecture, reviews existing workflow engines like Azkaban, Oozie and Airflow, and proposes a task‑and‑instance layered optimization that simplifies dependency configuration, improves collaboration, and supports complex scheduling in modern big‑data environments.

Big DataETLdependency management
0 likes · 21 min read
Optimizing Workflow in Data Warehouse Construction: A Layered Task‑Instance Approach
Liangxu Linux
Liangxu Linux
Jun 29, 2020 · Operations

Master Linux Scheduling: One‑Time and Recurring Tasks with at and crontab

This guide explains how Linux system administrators can automate one‑off and periodic jobs using the at command for single executions and the crond service with crontab for recurring tasks, providing concrete command examples, field syntax, and practical tips to avoid common pitfalls.

LinuxSystem Administrationat
0 likes · 9 min read
Master Linux Scheduling: One‑Time and Recurring Tasks with at and crontab
Full-Stack Internet Architecture
Full-Stack Internet Architecture
Jun 20, 2020 · Fundamentals

Applying the 5Whys Method to Diagnose and Resolve Workplace Issues

The article illustrates how the 5Whys root‑cause analysis can turn everyday workplace conflicts—like missed deadlines and poor communication—into actionable improvement plans by repeatedly asking why, encouraging systematic task scheduling, and fostering a habit of deeper inquiry for lasting productivity gains.

5WhysMobile DevelopmentRoot Cause Analysis
0 likes · 9 min read
Applying the 5Whys Method to Diagnose and Resolve Workplace Issues
Big Data Technology Architecture
Big Data Technology Architecture
Jun 11, 2020 · Big Data

Optimizing Workflow in Data Warehouse Construction

This article analyzes workflow scenarios in data warehouse construction, proposes an optimization scheme that abstracts workflow nodes into task and instance layers, and demonstrates how task attributes and generation rules can improve configurability, dependency management, and collaborative development for large‑scale data warehouse projects.

Big DataETLdependency management
0 likes · 19 min read
Optimizing Workflow in Data Warehouse Construction
DataFunTalk
DataFunTalk
Jun 6, 2020 · Big Data

Optimizing Workflow in Data Warehouse Construction: A Task‑Instance Layered Approach

The article analyzes workflow scenarios in data‑warehouse projects, proposes a two‑level model that abstracts workflow nodes into tasks and instances, defines period and dependency attributes, and presents generation rules that simplify configuration, improve collaboration, and support complex data‑processing schedules in modern big‑data environments.

Data WarehouseETLdependency management
0 likes · 19 min read
Optimizing Workflow in Data Warehouse Construction: A Task‑Instance Layered Approach
Tencent Cloud Developer
Tencent Cloud Developer
Apr 29, 2020 · Cloud Computing

Large-Scale Task Scheduling Architecture of Tencent Meeting and VStation

The talk explains how Tencent’s self‑developed VStation scheduler, integrated with TKE and using a hybrid sharding‑plus‑master‑worker architecture, enabled Tencent Meeting to scale to over 100 000 hosts and one million CPU cores, cutting provisioning time to under ten seconds while handling thousands of tasks per minute through DAG‑driven automation and fault‑tolerant mechanisms.

Distributed SystemsTencent MeetingVStation
0 likes · 24 min read
Large-Scale Task Scheduling Architecture of Tencent Meeting and VStation
Laravel Tech Community
Laravel Tech Community
Apr 18, 2020 · Backend Development

Master Laravel Task Scheduling: From Cron Setup to Advanced Constraints

This guide explains how to replace per‑task Cron entries with Laravel's unified scheduler, showing how to configure a single Cron line, define schedules in app/Console/Kernel.php using closures, invokable objects, Artisan commands, queue jobs, shell commands, and how to fine‑tune frequency, time windows, environment, timezone, overlapping, single‑server execution, background processing, maintenance mode, output handling, hooks, and URL pings.

ArtisanBackend DevelopmentLaravel
0 likes · 13 min read
Master Laravel Task Scheduling: From Cron Setup to Advanced Constraints
Youzan Coder
Youzan Coder
Mar 11, 2020 · Backend Development

Youzan Task Scheduling Platform (TSP): Design, Implementation, and Future Roadmap

Youzan’s Task Scheduling Platform (TSP) unifies its legacy cron and timeout systems into a modular, extensible framework that supports both timed and delayed tasks, offering per‑task rate limiting, sharding, isolation, retry policies, and a rich SDK, while its roadmap adds end‑to‑end monitoring, workflow orchestration, domain‑level clustering, transactional messaging, and dynamic task registration.

BackendTSParchitecture
0 likes · 14 min read
Youzan Task Scheduling Platform (TSP): Design, Implementation, and Future Roadmap
Alibaba Cloud Developer
Alibaba Cloud Developer
Feb 28, 2020 · Mobile Development

How Personalized Startup Task Scheduling Cuts Android Launch Time by 0.8 s

This article describes how Alibaba's HandCat team analyzed the growing startup latency of their Android app, identified static initialization bottlenecks, and implemented a data‑driven, per‑user and per‑device task orchestration using AOP instrumentation and algorithmic scheduling, achieving up to 1.6 s faster launches on low‑end devices.

AOP instrumentationMobilealgorithmic scheduling
0 likes · 15 min read
How Personalized Startup Task Scheduling Cuts Android Launch Time by 0.8 s
ITPUB
ITPUB
Feb 26, 2020 · Backend Development

Why XXL‑JOB Is the Lightweight Distributed Scheduler Used by 290+ Companies

XXL‑JOB is an open‑source, lightweight distributed task scheduling platform adopted by over 290 enterprises, offering 35 features, a decoupled scheduling‑center and executor architecture, and a thriving GitHub community with more than 12 K stars and 5 K forks.

BackendDistributed SystemsJava
0 likes · 5 min read
Why XXL‑JOB Is the Lightweight Distributed Scheduler Used by 290+ Companies
Alibaba Cloud Native
Alibaba Cloud Native
Jan 22, 2020 · Backend Development

Mastering Microservices: RPC, Service Discovery, Config, Scheduling & More

This comprehensive guide explains the benefits of microservices and walks through core building blocks such as RPC, service discovery, configuration management, task scheduling, distributed locking, unified monitoring, caching strategies, message queues, distributed transactions, CAP theory, seckill handling, Docker isolation, and modern CI/CD deployment pipelines.

BackendConfiguration ManagementMicroservices
0 likes · 24 min read
Mastering Microservices: RPC, Service Discovery, Config, Scheduling & More
58 Tech
58 Tech
Jan 6, 2020 · Big Data

Design and Architecture of the 58DP Big Data Platform Task Scheduling System

The article presents a comprehensive overview of the 58DP big data platform's task scheduling system, detailing its background, architecture, high‑availability design, slot‑based resource management, scheduling models, task lifecycle, priority rules, dependency handling, failure recovery, and future enhancements.

Big DataResource Managementdistributed system
0 likes · 14 min read
Design and Architecture of the 58DP Big Data Platform Task Scheduling System
HomeTech
HomeTech
Dec 12, 2019 · Big Data

Architecture and Design of the Home Data Integration Governance Platform

The article describes the background, architecture, and design principles of a unified big‑data scheduling and data‑exchange platform, detailing its data ingestion “direct‑train”, centralized scheduling engine, and DataX‑based data‑exchange components along with monitoring, alerting, and security features.

Big DataData IntegrationDataX
0 likes · 7 min read
Architecture and Design of the Home Data Integration Governance Platform
21CTO
21CTO
Oct 1, 2019 · Backend Development

How Ant Financial Scales Payments with Distributed Microservices and Database Sharding

This article explains Ant Financial's practical implementation of a distributed architecture—including micro‑service migration, modular development, database vertical and horizontal sharding, high‑availability mechanisms, task‑scheduling platforms, gray‑release strategies, and full‑link stress testing—to achieve reliable, scalable payment processing.

Cloud NativeMicroservicesdatabase sharding
0 likes · 8 min read
How Ant Financial Scales Payments with Distributed Microservices and Database Sharding
Java Captain
Java Captain
May 6, 2019 · Backend Development

Introduction to Spring Boot with Code Examples

This article provides a comprehensive tutorial on Spring Boot, covering its purpose, key advantages, project setup with Maven, essential configuration files, integration of JdbcTemplate, JPA, MyBatis, JSP, AOP, and task scheduling, all illustrated with complete Java code snippets.

Backend DevelopmentJavaMyBatis
0 likes · 12 min read
Introduction to Spring Boot with Code Examples
58 Tech
58 Tech
Apr 4, 2019 · Operations

Redesign of the Signal System for Task Scheduling and Dependency Management

This article explains the shortcomings of the legacy signal design in a scheduling platform, outlines four major dependency problems, and presents a newly engineered signal system with modular functions, instance ID generation, competitive priority rules, and state management to reliably support complex cross‑period and parallel job dependencies.

Operationspriority handlingsignal system
0 likes · 9 min read
Redesign of the Signal System for Task Scheduling and Dependency Management
Alibaba Cloud Developer
Alibaba Cloud Developer
Feb 1, 2019 · Artificial Intelligence

How an Automatic Pipeline Framework Supercharges AI Inference in Retail Surveillance

This article explains how Alibaba's automatic task‑pipeline system transforms deep‑learning inference for retail video streams by decoupling model execution from scheduling, using Python‑based pipelines, high‑performance shared memory, and robust fault‑tolerance, achieving up to 13% faster processing and double the camera capacity.

AI PipelineDeep LearningPerformance Optimization
0 likes · 22 min read
How an Automatic Pipeline Framework Supercharges AI Inference in Retail Surveillance
Youzan Coder
Youzan Coder
Jul 20, 2018 · Big Data

How Youzan Built a Scalable Big Data Development Platform (DP)

This article details the design, architecture, and operational experience of Youzan's Data Platform (DP), covering its scheduling, data‑sync, service, and monitoring modules, the custom Airflow‑based task scheduler, current production metrics, supported task types, and future improvement plans.

AirflowBig DataData Platform
0 likes · 12 min read
How Youzan Built a Scalable Big Data Development Platform (DP)
Java Captain
Java Captain
May 26, 2018 · Backend Development

Spring Task Scheduling: XML and Annotation Configurations with Cron Expressions

This article explains how to implement scheduled tasks in Spring using the lightweight Spring Task framework, covering both XML‑based and annotation‑based configurations, providing complete code examples, cron expression details, and practical tips for Java backend developers.

JavaXML Configurationannotation
0 likes · 9 min read
Spring Task Scheduling: XML and Annotation Configurations with Cron Expressions
Alibaba Cloud Developer
Alibaba Cloud Developer
Apr 12, 2018 · Backend Development

How Alibaba’s Cainiao Scales a Lightweight Timer Engine for Billions of Packages

Facing the challenge of processing over 100 million daily parcels, Alibaba’s Cainiao designed a lightweight, time‑wheel‑based scheduling engine that decouples task storage from timing, leverages partitioned task chains, master‑driven node IDs, and cluster‑wide soft‑load balancing to achieve scalable, fault‑tolerant timer processing.

Backend EngineeringCluster ManagementTime Wheel
0 likes · 12 min read
How Alibaba’s Cainiao Scales a Lightweight Timer Engine for Billions of Packages
Efficient Ops
Efficient Ops
Dec 19, 2017 · Databases

How ZanDB Automates MySQL Operations at Scale: A Deep Dive

ZanDB is Youzan's comprehensive MySQL automation platform that standardizes OS and database configurations, introduces a web‑based UI, task scheduling, backup monitoring, host and instance management, log analysis, metadata services, and high‑availability features to dramatically reduce manual DBA work and improve reliability.

Backup MonitoringMySQL automationZanDB
0 likes · 15 min read
How ZanDB Automates MySQL Operations at Scale: A Deep Dive
Yuewen Technology
Yuewen Technology
Nov 24, 2017 · Backend Development

How to Build a Scalable Distributed Task Scheduler from Scratch

This article outlines the shortcomings of using crontab for large‑scale job execution, defines the requirements for a custom distributed scheduler, describes its three‑component architecture (trigger, monitor, management), and details key technical solutions such as process isolation, distributed locking, and log aggregation.

Distributed SystemsQuartzcron replacement
0 likes · 12 min read
How to Build a Scalable Distributed Task Scheduler from Scratch
ITPUB
ITPUB
Oct 18, 2017 · Databases

How ZanDB Automates MySQL Backup, Task Scheduling, and Instance Management

This article outlines ZanDB's approach to standardizing MySQL environments, implementing a real‑time backup monitoring system, and building a comprehensive automation platform that includes task scheduling, host and instance management, log handling, metadata tracking, and daily maintenance to streamline DBA operations.

BackupDatabase ManagementZanDB
0 likes · 11 min read
How ZanDB Automates MySQL Backup, Task Scheduling, and Instance Management
BiCaiJia Technology Team
BiCaiJia Technology Team
Oct 14, 2017 · Backend Development

Mastering Quartz: How to Build a Page‑Based Task Scheduler

This tutorial walks through creating a web‑based task scheduling interface with Quartz, covering configuration, job definition, trigger setup, and UI integration to manage scheduled jobs through a visual page, including database persistence and real‑time status monitoring.

Backend DevelopmentQuartzWeb UI
0 likes · 1 min read
Mastering Quartz: How to Build a Page‑Based Task Scheduler
WeChat Backend Team
WeChat Backend Team
May 7, 2017 · Backend Development

How WeChat’s MQ 2.0 Redefined Asynchronous Queues for Massive Scale

This article explains the design and improvements of WeChat's MQ 2.0 asynchronous queue, covering its cross‑machine consumption model, enhanced task scheduling, MapReduce‑style processing, stream tasks, and robust overload protection that together enable high‑performance, resilient backend services.

Backend ArchitectureMessage Queueasynchronous processing
0 likes · 13 min read
How WeChat’s MQ 2.0 Redefined Asynchronous Queues for Massive Scale
Qunar Tech Salon
Qunar Tech Salon
May 5, 2017 · Backend Development

WeChat MQ 2.0: Enhanced Asynchronous Queue Design and Optimizations

The article introduces WeChat's self‑developed MQ 2.0 asynchronous queue, detailing its architecture, cross‑machine consumption model, improved task scheduling, efficient processing frameworks—including a MapReduce‑style engine and streaming tasks—and robust overload protection mechanisms that together boost reliability and performance for large‑scale backend services.

Distributed SystemsMapReduceMessage Queue
0 likes · 12 min read
WeChat MQ 2.0: Enhanced Asynchronous Queue Design and Optimizations
Weidian Tech Team
Weidian Tech Team
Nov 28, 2016 · Big Data

How We Built the Mars Big Data Platform to Boost Development Efficiency

The article explains why Weidian needed a new big data development platform, outlines the functional features of the Mars system, describes its architecture, scheduling mechanisms, task execution flow, and discusses remaining challenges and future enhancements.

Distributed SystemsHadoopplatform architecture
0 likes · 11 min read
How We Built the Mars Big Data Platform to Boost Development Efficiency
Meituan Technology Team
Meituan Technology Team
Sep 23, 2016 · Databases

Database Automation Platform at Meituan: Architecture, Practices, and Lessons

Meituan’s Database Automation Platform evolved from a simple Django‑based 1.0 system into a modular 2.0 architecture using CMDB, RabbitMQ, and Celery, standardizing metadata, providing self‑service APIs, and automating tasks such as cluster provisioning, online schema changes, and high‑availability failover, now handling hundreds of daily operations for over a thousand developers while planning further component‑library refactoring.

CMDBDevOpsdatabase automation
0 likes · 27 min read
Database Automation Platform at Meituan: Architecture, Practices, and Lessons
Liulishuo Tech Team
Liulishuo Tech Team
Jun 17, 2016 · Big Data

Building a Scalable Big Data Platform on AWS: Architecture and Execution Service Design

This article details the architectural design and implementation of a scalable big data platform built on AWS services, highlighting the transition from HDFS to S3 for storage, the use of EMR for elastic compute, and a custom Execution Service integrated with Consul and Airflow for automated cluster management and task scheduling.

AWS EMRAirflowBig Data Architecture
0 likes · 11 min read
Building a Scalable Big Data Platform on AWS: Architecture and Execution Service Design
High Availability Architecture
High Availability Architecture
Mar 18, 2016 · Backend Development

High‑Availability Architecture of Upyun Image Processing Service

The article details Upyun's high‑availability image processing architecture, covering workload‑aware system design, custom GmServer implementation, task scheduling, current strengths and limitations, and future directions such as a ServiceServer‑based queue and Docker‑driven dynamic scaling.

Backend ArchitectureCloud ServicesDocker
0 likes · 15 min read
High‑Availability Architecture of Upyun Image Processing Service
MaGe Linux Operations
MaGe Linux Operations
Oct 21, 2015 · Operations

How JobCenter Transforms Distributed Task Scheduling in E‑Commerce

JobCenter is a distributed task coordination platform that replaces crontab with a unified scheduling, monitoring, and alerting system, enabling e‑commerce teams to manage thousands of web‑service‑based jobs, ensure reliable execution, and gain clear visibility into task performance.

AutomationDistributed SystemsOperations
0 likes · 7 min read
How JobCenter Transforms Distributed Task Scheduling in E‑Commerce
MaGe Linux Operations
MaGe Linux Operations
Jul 10, 2014 · Operations

Mastering Linux Cron: How to Schedule Tasks Efficiently

This guide explains what the Linux cron service is, how to configure it via /var/spool/cron and /etc/crontab, the syntax of cron expressions, environment variables, and provides practical examples for scheduling recurring tasks.

Automationcrontask scheduling
0 likes · 9 min read
Mastering Linux Cron: How to Schedule Tasks Efficiently