This article demonstrates three practical ways to schedule Python web‑crawling tasks—using an infinite while loop, the Timer module, and the sched module—providing code snippets, usage tips, and considerations for handling multiple runs and resource constraints.
This comprehensive guide covers over forty operating system interview questions, explaining core concepts such as OS fundamentals, process and thread management, memory handling, file systems, I/O mechanisms, scheduling algorithms, and deadlock prevention, providing detailed answers and diagrams to help candidates excel in technical interviews.
This article walks through the design, pitfalls, and deep optimizations of a Node.js + TypeScript backend that periodically syncs enterprise WeChat organization data to a MySQL store and provides a phone‑number lookup API, offering practical solutions for rate limits, process management, database conflicts, and error recovery.
This comprehensive guide covers the fundamentals of processes and threads, their definitions, relationships, creation, lifecycle, scheduling strategies, context switching, inter‑process communication methods, and practical C/C++ examples, providing a deep dive into operating‑system concepts for developers and interview preparation.
This article details how the L‑D stage of international hotel pricing was optimized through a new offline‑fetch scheduling mechanism, cache‑freshness calculations, and a comprehensive refactor of the rebuild system, resulting in lower latency, higher throughput, and a smoother user experience.
Meituan’s autonomous vehicle engine abstracts communication, scheduling, data handling, and tooling into three layers to ensure deterministic behavior across on‑vehicle and simulation environments, tackling consistency, scheduling, and resource‑utilization challenges by using unified computation models, distributed graph deployment, caching, and remote model serving, thereby accelerating autonomous delivery vehicle development.
This article walks through a practical approach for front‑end engineers to cut down a sluggish legacy API from over three seconds to under a second by adding a Node.js proxy layer that leverages GraphQL field selection, Redis caching, and a scheduled cache refresh.
Learn how Spring Boot 2.4 replaces the old CronSequenceGenerator with CronExpression, enabling advanced scheduling features such as built-in macros, last-day-of-month, weekday, and week-of-month semantics, with practical code examples and a reference table of common macros.
This article explains the true behavior of Thread.Sleep, how it interacts with operating system scheduling—both time‑slice and pre‑emptive models—and clarifies the differences between Sleep(milliseconds) and Sleep(0) for thread coordination.
This guide explains Linux's cron daemon, its configuration files, permission controls, how to write and install crontab scripts, and provides numerous scheduling examples, helping administrators automate tasks efficiently, including command syntax, special characters, and common service commands.
This guide explains the Linux cron daemon, how to control the crond service, configure system and user crontabs, manage permissions, create custom cron scripts, use the crontab command syntax, and provides numerous practical scheduling examples.
The article analyzes the limitations of native Kubernetes scheduling, proposes usage‑based and dynamic‑weight scheduling strategies to improve multi‑resource balance, presents experimental results showing significant CPU and memory utilization gains, and discusses cost benefits and future directions for the private cloud platform.
This article provides a comprehensive analysis of Google’s Borg system, covering its design goals, user view, job and task model, resource allocation, scheduling algorithms, fault tolerance, scalability techniques, and operational metrics that shaped modern cloud‑native orchestration platforms.
This article explains Java's ScheduledThreadPoolExecutor, covering its two scheduling modes—fixed‑rate and fixed‑delay—its underlying DelayedWorkQueue implementation, and how it employs the Leader‑Follower pattern to efficiently manage delayed task execution.
React Fiber replaces the old Stack Reconciler with a linked‑list of Fiber nodes that enable incremental, pause‑and‑resume rendering, priority scheduling, and a three‑step commit phase, allowing smoother asynchronous updates, better performance, and the foundation for Concurrent Mode and Suspense.
This article provides a comprehensive overview of Linux fundamentals, covering process and thread concepts, various inter‑process communication mechanisms, essential system calls, process descriptors, scheduling algorithms such as O(1) and CFS, synchronization primitives, and the operating system boot sequence.
This article provides a comprehensive overview of Linux fundamentals, covering process and thread concepts, the fork and exec system calls, various inter‑process communication mechanisms, memory layout, scheduling algorithms such as O(1) and CFS, synchronization primitives, and the boot sequence, all illustrated with code snippets and diagrams.
This article explains operating system fundamentals such as process and thread definitions, time‑slice preemptive scheduling, process features and lifecycle, thread characteristics, priority handling, multi‑core execution models, and synchronization mechanisms like mutexes and semaphores.
The article explains why proper business system design is crucial for low‑coupling, illustrating concepts such as listener and observer patterns, asynchronous execution, scheduled tasks, and message middleware with Java code examples to show how to achieve modular, maintainable back‑end services.
The article explains the design and operation of Linux’s BFQ (Budget Fair Queueing) I/O scheduler, its algorithmic advantages over CFQ, performance test results, and the reasons it outperforms other schedulers, concluding with its growing adoption in major projects.
This article explains the evolution of container runtimes, the introduction of the Container Runtime Interface, and how Kubernetes RuntimeClass—introduced in v1.12 and expanded in later versions—enables multiple runtimes, custom scheduling, and pod overhead accounting, with practical YAML examples and multi‑runtime deployment scenarios.
This article provides a comprehensive overview of operating system concepts including processes, threads, interprocess communication, synchronization mechanisms such as mutexes and semaphores, and various scheduling algorithms for batch, interactive, and real‑time systems.
This article provides a comprehensive technical overview of TiDB, covering its HTAP design, TiKV storage engine with RocksDB and Raft replication, the mapping of relational tables to key‑value pairs, MVCC implementation, transaction handling, and the PD scheduler that balances replicas, leaders, and hot spots across a distributed cluster.
Meituan’s intelligent delivery system integrates operations‑research, machine learning, and IoT across three layers—structural optimization, market adjustment, and real‑time matching—to plan smart areas, schedule riders, route orders, and dispatch efficiently, achieving measurable travel‑distance reductions and significant time savings.
This article explores the design principles, evolution, and implementation details of schedulers across operating systems, the Go programming language runtime, and Kubernetes, covering concepts such as task and resource allocation, cooperative vs. preemptive scheduling, work‑stealing, priority algorithms, and the latest scheduling framework extensions.
The article details how Ctrip engineers diagnosed sporadic Redis timeouts in containerized deployments, traced the problem to kernel scheduling delays caused by an APIC‑ID bug that inflated the possible‑CPU count, and resolved it by applying a kernel patch, offering verification steps for affected systems.
This article explains how Linux reports CPU usage with tools like top, the meaning of the fields in /proc/stat, how utilization percentages are calculated, the concepts of run queues, load average, context switching, multi‑core scheduling, and how to use perf and taskset for deeper performance analysis.
Go achieves high concurrency by using its own M‑P‑G scheduling model, where lightweight goroutines (G) run on logical processors (P) that are mapped onto kernel threads (M), allowing user‑space scheduling that avoids the overhead of OS thread context switches.
This article presents a comprehensive analysis of Meituan's Hadoop YARN fair scheduler, detailing its architecture, resource abstractions, scheduling workflow, performance bottlenecks, fine‑grained metrics, and a series of optimization techniques—including sorting improvements, job‑skip reduction, parallel queue sorting, and robust rollout strategies—to achieve high‑throughput, low‑latency scheduling for large‑scale offline, streaming, and machine‑learning workloads.
This article details Meituan‑Dianping's evolution from a custom Docker‑based cluster manager to the open‑source Kubernetes‑powered HULK2.0 platform, describing its architecture, operational practices, scheduler and Kubelet optimizations, and resource‑management techniques that enable massive, cost‑effective scaling.
This article presents a comprehensive overview of Taobao's cloud computing architecture, detailing system components, various data synchronization methods such as TimeTunnel, Dbsync, and DataX, the scheduling system design, and metadata-driven analysis platforms for performance optimization and monitoring.
Learn how to use Python's wxpy library to create a WeChat bot that automatically sends personalized greetings, holiday wishes, birthday messages, and English learning prompts to your girlfriend at scheduled times, while also performing simple sentiment analysis of her replies.
To handle terabytes of daily data and diverse business needs, the company built a three‑layer basic data platform—collection/computation/storage, unified data management, and API‑driven services—augmented by a standardized collection system, a robust Domino scheduler, and a self‑service analysis tool, aiming to evolve into a full data‑middle‑office for end‑to‑end intelligence.
This article explains the Kubernetes architecture, details each core component, demonstrates how a Deployment is created, and critically compares Kubernetes' two‑layer scheduling model with Mesos, evaluating resource utilization, scalability, flexibility, performance, and scheduling latency while discussing why cluster schedulers struggle with horizontal scaling.
This article explains Linux process management fundamentals, covering process concepts, lifecycle, threads, priorities, context switches, interrupt handling, process states, memory layout, and the O(1) CPU scheduler, providing clear diagrams and practical insights for developers and system engineers.
This article explains Linux process management fundamentals, covering process concepts, lifecycle, threads, priorities, context switches, interrupts, process states, memory layout, and the O(1) scheduler, with clear diagrams to help readers understand kernel behavior and performance impact.
Meitu’s container platform, built on Kubernetes with Calico networking, a custom Nginx load‑balancer, unified logging, refined scheduling, autoscaling, and comprehensive monitoring, enables seamless multi‑cluster hybrid‑cloud operations for its hundreds‑of‑millions‑user services while providing CI/CD tooling and future‑ready extensions such as service mesh and edge computing.
Alibaba has released the comprehensive Cluster Data V2018 dataset, detailing eight days of operation for 4,000 servers and their mixed online and offline workloads, including DAG information, enabling researchers to study large‑scale data‑center performance, resource utilization, scheduling algorithms, and derive new insights.
CynosDB’s Storage Cluster Manager (SCM) orchestrates storage utilization by maintaining pool‑SG relationships in Etcd, using Raft for leader election, exposing HTTP APIs, and running heartbeat‑driven pool and segment‑group schedulers that allocate, expand, contract, and balance SG replicas across regions, zones, racks, and hosts.
This article introduces cron on macOS and Linux, explains its purpose as a periodic task scheduler, shows how to check its status, add, list, and remove jobs using crontab commands, demonstrates common syntax, and shares troubleshooting tips for environment variables and log management.
The XSigma system combines AI‑driven demand forecasting, real‑time optimization, visual decision‑making and intelligent training to automatically schedule, scale, balance load and match customers with the best agents, dramatically improving resource utilization and user experience for Alibaba’s massive CCO operation.
The article describes JD’s experience of redesigning Kubernetes at massive scale, detailing the JDOS2.0 platform, custom DNS and load‑balancing, the Archimedes scheduler, API and controller optimizations, and operational lessons learned from running tens of thousands of nodes in production.
This article explains how modern data centers rely on cluster resource management systems and sophisticated scheduling algorithms to allocate containers across machines, improve application availability, reduce costs, and meet diverse constraints, while also introducing Alibaba’s global scheduling algorithm competition and its challenge details.
This article explains why React Fiber was introduced, describes its core concepts such as the fiber tree, work‑in‑progress tree, double buffering, priority scheduling, and lifecycle changes, and summarizes the new capabilities it brings to improve UI performance and responsiveness.
This article explains Linux process fundamentals, scheduling, the creation of zombie processes, their causes, and practical methods to avoid them, while also comparing processes and threads and discussing multithreading concepts and synchronization techniques.
This guide explains what the cron daemon does on Linux, how to control the service, where its configuration files reside, permission handling, creating cron scripts, crontab syntax, and provides numerous practical scheduling examples for system administrators.
An in‑depth guide to Linux process management covering process concepts, lifecycle, threads, priority, context switching, interrupt handling, process states, memory layout, and the O(1) scheduler, illustrated with diagrams to help readers understand kernel behavior and performance implications.
This article explores how cloud gaming platforms manage resources by addressing latency, bandwidth, and cost challenges, defining scheduling problems similar to dynamic bin packing, evaluating classic and new algorithms—including AI‑driven predictions—and proposing strategies to minimize total server runtime and deployment overhead.
This talk details Baidu Waimai's end‑to‑end ETL design, covering demand sources, data flow patterns, multi‑stage system evolution, storage choices, scheduling architecture, configuration‑driven processing, quality monitoring, and how data lineage enables transparent, self‑service data delivery.
In this talk, a Baidu Waimai engineer explains the motivations, requirements, and architectural choices behind their open‑source ETL platform, covering data flow patterns, logical mappings, storage options, scheduling, metadata management, and quality monitoring to achieve scalable, transparent, and explainable data delivery.
This article describes a cloud‑based intelligent logistics scheduling platform for food‑delivery services that leverages big‑data analytics, deep‑learning prediction models, and visualisation tools to achieve multi‑objective dynamic optimization, improve dispatch efficiency, and enhance user experience across thousands of cities.
This article explains the architecture and challenges of network‑based scheduling systems, CDN and DNS‑driven video playback, the structure of the QQWry IP database, and proposes efficient IP‑based routing and quality‑monitoring methods for large‑scale backend services.
This article explains Linux process management fundamentals, covering process concepts, lifecycle, threads, priority and nice values, context switching, interrupt handling, process states, memory segments, and the O(1) CPU scheduler, providing clear insights into kernel behavior and system performance.
This article, translated from IBM’s RedBook, explains Linux process management fundamentals—including process lifecycle, threads, priorities, context switching, interrupt handling, process states, memory layout, and the O(1) scheduler—providing clear insights into how the kernel handles processes and impacts system performance.
This article provides an in‑depth explanation of Hadoop MapReduce architecture, covering the roles of JobClient, JobTracker, TaskTracker and HDFS, the complete job lifecycle from submission to completion, scheduling strategies, shuffle and sort mechanisms, fault tolerance, and performance tuning techniques.
This article explores two practical approaches to implementing a delayed queue—using a sorted‑queue with JDK's DelayQueue logic and a Redis‑based solution with ordered sets and Spring Scheduled—to handle high‑throughput order processing while discussing their trade‑offs and implementation details.
This guide explains how to achieve second‑level scheduling on Linux by combining a minute‑based crontab entry with a custom Bash script that loops and uses sleep, including a PHP test task example and step‑by‑step setup instructions.
This article demystifies threads and processes, explaining OS task scheduling, the differences between them, various threading models (one-to-one, many-to-one, many-to-many), their relationship with multicore CPUs, and how to view thread and process information on Windows.
This article compiles recent high‑availability architecture discussions covering plugin‑based system design, simple kanban tools, independent scheduling services, challenges of managing 60‑billion‑row tables, and the trade‑offs between UUIDs and custom distributed ID generators, offering practical insights for backend engineers.
The article explains how Unix-like systems calculate load average using an exponentially damped weighted moving average, how the values reflect CPU and I/O contention on single- and multi‑CPU machines, and why different kernel implementations may count processes and threads differently, affecting performance monitoring.
This article provides a comprehensive overview of Google’s Borg system, detailing its purpose, user perspective, workload types, cluster and cell architecture, job and task management, scheduling algorithms, scalability techniques, and availability mechanisms for large‑scale distributed environments.
This article explains Linux's real‑time and general scheduling policies—including SCHED_RR, SCHED_FIFO, SCHED_NORMAL, SCHED_BATCH, and SCHED_IDLE—describes their behavior, and demonstrates their impact on CPU allocation through practical chrt command tests.