This article details Ctrip's journey of building and operating a massive container cloud platform, covering its architectural evolution, operational challenges, tooling, capacity management, and future directions, offering practical insights for large‑scale cloud‑native environments.
The article presents a detailed critique of Docker, arguing that despite its marketed benefits of portability, security, and resource management, its design introduces significant complexity, hidden costs, and operational risks that many organizations overlook when adopting it for production workloads.
This article explains how network engineers can use lightweight monitoring solutions, log analysis, traffic and error tracking, and custom automation scripts to gain visibility, reduce troubleshooting time, and safely automate routine network tasks in enterprise environments.
During the 2019 Chinese New Year Gala, Baidu mobilized a massive technical operation—scaling cloud resources, isolating traffic, and deploying AI‑driven security—to flawlessly process over 9 billion red‑packet interactions despite unprecedented traffic spikes and login surges.
The article critically examines Docker’s promised benefits—portability, security, and orchestration—highlighting its design shortcomings, hidden complexities, lock‑in risks, and the often‑overlooked alternatives that can deliver the same goals with far less overhead.
This article explains how to approach monitoring for a newly introduced system by focusing on white‑box metric collection, distinguishing basic and business metrics, outlining common collection methods, and detailing Google SRE's four golden indicators—error, latency, traffic, and saturation—to guide effective observability.
This article explains the differences between white‑box and black‑box monitoring, outlines common data‑collection techniques for both basic and business metrics, and details Google SRE’s four golden indicators—error, latency, traffic, and saturation—to help engineers design effective monitoring solutions.
The author shares a journey from a college Linux basics class to becoming an operations manager, detailing early hands‑on tasks, challenges in chaotic server environments, the creation of monitoring systems, and three key career lessons about learning, deepening technical understanding, and evaluating workplace fit.
This article details Youku's rapid, large‑scale IPv6 rollout—from initial pilot to half‑million users—covering the motivations, phased migration plan, technical challenges, implementation steps across client and server, gray‑release strategies, monitoring, and future outlook.
As internet traffic surges, organizations must juggle legacy and new architectures while balancing stability and cost, prompting a shift toward goal‑oriented operations platforms that let systems automatically determine optimal actions based on real‑time conditions and knowledge bases.
This talk outlines Alibaba’s massive global host infrastructure, the evolving security governance from manual controls to data‑driven, automated systems, the challenges of compliance and operational efficiency, and future directions such as zero‑trust and invisible security.
This article details UCloud's five‑month, multi‑department hot migration of its Seoul data center, covering planning, ZooKeeper scaling, udatabase and MySQL migration strategies, deployment platforms, and the final cut‑over steps that ensured zero user impact.
This article explores the essential concepts for selecting and building an operations monitoring platform, reviewing popular tools such as Cacti, Nagios, Zabbix, Ganglia, Centreon, Prometheus, and Grafana, and outlines a six‑layer architecture and practical strategies for scaling, alerting, and high‑availability in diverse environments.
This article outlines ten practical guidelines for DBAs and system administrators—including rollback‑ready changes, cautious use of destructive commands, prompt customization, reliable backups, production respect, thorough handovers, alerting, monitoring, careful failover, meticulous checks, and the virtue of simplicity—to minimize costly system outages.
This article presents Ctrip's extensive AIOps exploration, detailing operational challenges caused by massive monitoring data, the evolution of DevOps practices, the design of intelligent anomaly detection and diagnosis systems, practical use cases, and a forward‑looking perspective on the future of AI‑driven operations.
This article systematically explains how to enhance e‑commerce platform availability by implementing both black‑box monitoring to detect functional failures and white‑box monitoring to pinpoint root causes, detailing core order‑process metrics, common issues, mitigation strategies, and illustrative Grafana dashboards.
This guide outlines critical operational practices for Linux server management, emphasizing thorough testing, cautious command execution, regular backups, strict access controls, comprehensive monitoring, performance tuning, and a disciplined mindset to avoid costly incidents and ensure system stability.
This guide walks you through installing and configuring mailx, creating Zabbix email alert scripts, and integrating WeChat notifications by setting up the necessary scripts, parameters, and media actions within the Zabbix web interface.
The 58 Intelligent Monitoring System provides a flexible, 24/7, multi‑dimensional monitoring solution that covers network, server, system, application and business layers, incorporates AI‑driven prediction, anomaly detection, alarm merging, root‑cause analysis and self‑healing, and offers both PC and WeChat interfaces for operators.
This article explains how Baidu Cloud's Noah intelligent operations product builds a unified operations knowledge base by categorizing metadata, status, and event data and applying three ETL approaches—Pull, Push, and Lazy—to handle offline, near‑line, and real‑time data integration.
This guide walks through a step‑by‑step investigation of a sudden 98% CPU spike on a data‑platform server, showing how to pinpoint the offending process, trace the problematic Java thread, analyze the root cause in a time‑utility method, and apply an optimized solution that reduces CPU load by thirtyfold.
This article explains the concept of service degradation, why it is needed to maximize limited resources during traffic spikes, outlines common degradation strategies, and provides practical steps and code examples for ranking, sequencing, and implementing degradation in both front‑end and back‑end systems.
The article introduces the Kanban method as a lean approach to managing professional services, outlines ten essential principles such as focusing on flow, incremental change, risk management, and scalability, and concludes with a recruitment announcement seeking DevOps engineers in Beijing.
Youku’s pioneering IPv6 migration, launched in early 2018 and completed by Double 11, progressed through external, dual‑stack internal, and IPv6‑only phases, tackled test‑environment, MTU, and library issues, employed sophisticated gray‑release and monitoring, and ultimately unlocked unlimited address space, enhanced security, and faster, scalable video delivery.
This talk outlines why organizations pursue cloud adoption, defines cloud‑native goals, reviews emerging trends such as bare‑metal and hyper‑convergence, and shares practical private‑cloud operation experiences, including ITIL processes, project management, and tooling, offering a comprehensive view of national‑level private‑cloud practice.
Ant Financial’s internal red‑blue technical attack‑defense program, driven by a dedicated blue team and SRE‑based red team, continuously probes system weaknesses, refines fault‑injection tools like Awatch, and evolves high‑availability and self‑healing mechanisms to strengthen risk control and operational reliability.
The article details JD's intelligent supply chain enhancements—including machine‑learning demand forecasting, a new "explosive product warehouse" model, non‑stock fulfillment visualization, blockchain‑based product traceability, and comprehensive system‑stability measures such as data‑consistency checkpoints, throughput buffering, and 24/7 incident response—to boost efficiency and reliability during large‑scale promotions.
This article recounts several real incidents where disgruntled engineers or admins deleted critical databases as retaliation, highlighting the severe consequences and stressing that proper backups and cautious use of destructive commands are essential for any organization.
The article uses a restaurant scenario to explain the differences between centralized, cluster, and distributed system deployments, illustrating how performance, security, scalability, and availability map to user requirements and why scaling from a single server to clusters and distributed architectures is essential as demand grows.
This article explains how to monitor the Puppet configuration management system, covering its request‑response‑execution‑report workflow, key monitoring metrics, black‑box and white‑box monitoring approaches, common issues, and practical solutions for ensuring large‑scale cluster consistency.
The article explains why visualizing microservice architectures is essential for high availability, describes common and advanced visualization methods, discusses how to make visualization effective, handle architectural changes, identify key components, and leverage visual data for operations and reliability improvements.
In this talk, Alibaba senior tech expert Wang Zhaogang explains how intelligent monitoring, powered by machine‑learning algorithms and multi‑metric analysis, addresses the challenges of diverse business scenarios, enhances anomaly detection, improves root‑cause analysis, and shapes the future of smart operations.
The article explains Docker’s rapid rise, clarifies the distinction between Docker and containers, compares containers with virtual machines, and describes why Docker simplifies application deployment, while also noting a related DevOps live‑stream event and promotional details.
This guide walks you through preparing a Linux disk, safely protecting the partition, installing extundelete, and using it to restore both files and directories that were mistakenly removed, providing practical commands and screenshots for each stage.
This article details the core capabilities of Nginx without third‑party modules, including reverse proxy, various load‑balancing strategies, static and dynamic HTTP serving, forward proxy setup, and hot‑reload commands, providing clear configuration examples for each feature.
This guide walks through configuring static IP, netmask, gateway, and DNS for each node in a virtual‑machine cluster on Linux, showing exact file edits for the master and slave machines, testing connectivity with ping commands, and confirming the network setup is complete.
JD's chief scientist Shen Zuo‑jun explains how shortening the decision chain with end‑to‑end algorithms and intelligent multi‑level replenishment dramatically improves inventory turnover, stock availability, and forecasting accuracy, showcasing a novel supply‑chain research direction that integrates AI, big data, and human expertise.
The article shares a comprehensive, experience‑driven guide on building fault‑tolerant systems—covering retry mechanisms, dynamic node removal, timeout settings, service degradation, decoupling, and business‑level safeguards—to enable a platform that scales from millions to billions of daily requests without relying on manual fire‑fighting.
This guide outlines why Linux dominates the internet, recommends starting with CentOS or RHEL, suggests effective learning resources, and lists the core knowledge, tools, and advanced topics every aspiring Linux operations engineer should master.
The Lingjing system, built by Alibaba Infrastructure, provides an end‑to‑end hardware‑software performance diagnosis platform that collects fine‑grained metrics, visualizes data, automatically detects anomalies, and helps optimize resource utilization across complex data‑center stacks.
The article details how JD Logistics’ extensive warehouse, routing, distribution, and fulfillment systems—leveraging big data, AI, GIS, IoT, and distributed architectures—were engineered and optimized to handle the massive order surge during the 11.11 Global Shopping Festival with high throughput, low latency, and zero incidents.
Alibaba’s massive data‑center operations face growing hardware failures, so they built the DAM (Dammo) platform that integrates Tianji management, predictive fault detection, automated remediation, and self‑balancing cluster reconstruction, achieving near‑complete hardware issue coverage and reducing manual intervention across hundreds of thousands of servers.
This article introduces thirteen practical Linux operation tools—including Nethogs, IOZone, IOTop, IPtraf, IFTop, Fail2ban, and more—providing concise descriptions, download links, and step‑by‑step installation commands to help system administrators monitor performance, network traffic, and protect against attacks.
The article outlines eBay's key scalability best practices—including functional partitioning, horizontal sharding, avoiding distributed transactions, aggressive asynchronous decoupling, moving work to async pipelines, pervasive virtualization, and intelligent caching—to achieve linear or better resource usage as load grows.
This article presents 360's AIOps project, detailing how AI-driven capacity forecasting, host classification, resource recycling, intelligent MySQL scheduling, anomaly detection, alarm convergence, and root‑cause analysis have saved millions, improved efficiency, and paved the way for a fully automated operations workflow.
The article details Ant Financial's development of a highly available wireless test cluster that supports automated testing for its massive mobile app ecosystem, describing its architecture, data‑driven monitoring, full integration, and the All‑in‑One solution that enables rapid, cost‑effective iteration across dozens of services and IoT scenarios.
At Didi, the team replaced a chaotic mix of Kafka, Redis, and other queues with a custom, RocketMQ‑based service, using dual‑write and dual‑read migration, extensive performance testing, custom failover, batch extensions, and operational tweaks to achieve stable high‑throughput, low‑latency messaging at massive scale.
This article explains how Alibaba’s massive data‑center operations detect hardware failures early, automatically isolate faulty servers, and execute self‑healing workflows through a centralized, cloud‑native platform, detailing detection methods, convergence rules, architecture evolution, and the benefits of a closed‑loop AIOps system.
This tutorial walks you through the complete process of safely expanding a VMware virtual machine's disk, from powering off the VM and logging into vSphere Client to adding a new hard disk, configuring its size, and confirming the successful expansion with screenshots.
The article announces the open-source release of the Windows Agent component under the Apache license, its integration into the Open-Falcon community, future feature enhancements, and gratitude to contributors, while providing links to the source code and related documentation.
This article explores how the VUCA-driven volatility of modern FinTech demands robust, multi‑layered monitoring solutions and explains why Zabbix, with its open‑source flexibility, automated discovery, and deep integration capabilities, is a compelling choice for achieving resilient, automated operations.
This article chronicles Alibaba's decade‑long journey of capacity planning for Double 11, detailing five evolutionary phases—from manual estimates to full‑link testing ecosystems—while balancing cost, stability, and efficiency in massive distributed systems.
The article shares practical reflections on a two‑year DevOps transformation, examining the integration of development and operations, the shift to product‑oriented teams, and the decentralization of the IT operations department, while highlighting emerging challenges and key lessons for supporting global business.
The article summarizes the 58 Group technical salon where experts from Momo and 58 shared practical experiences on monitoring platform architectures, coverage, alarm configurations, convergence techniques, custom dimensions, multi‑view dashboards, and future directions for intelligent and automated monitoring across the company.
Over ten years of Alibaba's Double 11, the company transformed a modest marketing event into a global e‑commerce platform by continuously improving backend architecture, scaling strategies, full‑link stress testing, multi‑active data centers, cloud migration, and real‑time incident response, offering valuable operational insights.
This article outlines comprehensive Linux security measures—including account hardening, remote access protection, file system safeguards, rootkit detection tools, and step‑by‑step post‑attack response—to help system administrators strengthen server defenses and quickly recover from compromises.
Marking the 10th anniversary of Double 11, ZTO Technology details how it tackles massive traffic spikes with an automatic sorting management platform, a high‑availability IDC and private cloud, smart voice and face‑recognition services, real‑time data dashboards, and extensive performance testing to ensure stable, fast, and accurate order fulfillment.
From its humble 2009 launch to the 2018 tenth anniversary, Alibaba’s Double 11 shopping festival evolved through relentless technical challenges—system crashes, CDN bottlenecks, over‑selling bugs, and massive load‑testing innovations—offering a decade‑long case study in operations, scalability, and resilience for large‑scale e‑commerce platforms.
From the humble 2009 launch of Double 11 to the massive, cloud-native, multi-region architecture of 2018, Alibaba’s engineers chronicle yearly technical hurdles—traffic spikes, system crashes, CDN limits, over-selling, and the evolution of stress-testing, capacity planning, and operational safeguards that turned the shopping festival into a global engineering showcase.
This guide walks Linux administrators through common signs of server compromise, shows how to examine logs, user files, active processes, network traffic, and demonstrates using lsof and /proc to recover deleted log files, all with concrete command examples.
This article shares a detailed, experience‑driven guide on Elasticsearch tuning, covering data model fundamentals, storage cost reductions, cluster stability tricks, performance‑boosting settings, and custom kernel improvements, all illustrated with real‑world diagrams and Q&A insights.
Li Xiaohui shares Tencent Cloud MongoDB’s real‑world mini‑game operations, detailing schema‑free design, sharding, thread‑per‑connection tuning, snapshot‑based read fixes, and table‑level rollback, then demonstrates a one‑click cloud stack that provisions MongoDB, serverless functions, storage, monitoring and security for mini‑program developers.
The article explains how to achieve precise, real‑time detection of physical server outages, reduce false alarms through heartbeat monitoring, network and special‑case interference filtering, and detailed analysis, ultimately improving detection accuracy and coverage for reliable operations.
This article examines why automated operations are essential for growing game businesses, outlines the goals of a complete, simple, efficient, and secure system, and details the architecture and individual subsystems—including installation, platform, security, client updates, backup, and monitoring—that together form a robust DevOps solution.
This article shares practical strategies for avoiding system failures by doubting third‑party services, protecting against misuse by consumers, and strengthening internal design through solid API practices, resource limits, and disciplined coding principles.
This article explains how to assess and model system I/O capabilities, presents common disk and network I/O benchmarking tools, outlines key performance metrics and monitoring utilities, and offers detailed optimization approaches for storage, network, and low‑latency transaction scenarios.
This article outlines Youzan's end‑to‑end online incident management process—from fault detection and coordination through root‑cause analysis, recovery, review, and actionable JIRA tracking—highlighting practical workflows, data analysis, and continuous improvement practices for reliable service delivery.
The article introduces SGM, a comprehensive service governance and monitoring solution that addresses scaling, dependency complexity, and operational challenges by providing automated topology, real‑time tracing, capacity planning, root‑cause analysis, and extensive monitoring features such as performance metrics, JVM stats, call‑chain visualization, business dashboards, and intelligent alerting.
This article outlines the scope, terminology, classification levels, site selection principles, equipment layout, and subsystem requirements—including lighting, grounding, lightning protection, HVAC, monitoring, and cabling—for building and operating data center facilities in accordance with industry standards.
The article explains what constitutes a fault, introduces key metrics such as RPO and RTO, and describes various fault isolation principles, patterns, and practical examples—including dependency degradation, failover, dynamic adjustment, fast‑fail, caching, rate limiting, and resource isolation—to improve system reliability.
This article explains what load balancing is, compares it to navigation routing, and details five common strategies—round‑robin, weighted round‑robin, least connections, fastest response, and hash‑based—along with their pros, use‑cases, and health‑check mechanisms for achieving high availability.
This article explains how Alibaba’s mixed‑deployment (co‑location) technology combines online transaction services and offline compute workloads on shared physical servers, detailing its architecture, scheduling mechanisms, resource‑concession strategies, achieved performance gains, and future directions for large‑scale e‑commerce infrastructure.
The article explores why many operations engineers feel unhappy, identifies achievement and compensation as key to happiness, explains the internal and external value of ops work, and outlines how a dedicated ops team can improve product speed, stability, cost efficiency, and overall business outcomes.
The article explains why a downtime diagnosis system is needed, outlines its architecture and implementation methods—including log sources, feature extraction, and API integration—and presents early results showing high automation coverage and significant operational cost savings.
The Jenkins Area Meetup 2018 in Shenzhen, co‑hosted by DevOps时代社区 and vivo Mobile Internet, gathered experts who presented on hybrid‑cloud DevOps, large‑scale CI/CD with Jenkins at Tencent, DevOps‑based R&D and operations standards, and an automated CMDB‑driven operations platform, concluding with strong community engagement and available presentation materials.
The article details Weibo Advertising's Hubble monitoring system, describing its three‑layer architecture, metric taxonomy, AI‑driven trend prediction with LSTM models, dynamic alert thresholds, and performance testing using GoReplay, illustrating how large‑scale data and machine learning enable proactive operations.
Fabric is a Python library that lets you write task scripts and execute them over SSH on multiple hosts, providing a powerful way to automate deployments, system administration, and other large‑scale remote operations.
This article explains how to use Nginx’s built‑in limit_req and limit_conn modules to implement request‑rate and connection‑based throttling, covering configuration directives, execution flow, burst handling, delay modes, whitelist setup with geo and map modules, and practical examples for IP and domain limits.
This article explains Alibaba's mixed‑deployment (co‑location) technique, detailing its motivation, architecture, resource‑sharing mechanisms, scheduling strategies, performance results, and future directions for scaling and refining resource utilization across online and offline workloads.
This article explains why Redis is a popular in‑memory key‑value store, defines high availability, enumerates failure scenarios, and walks through four incremental architectures—single instance, master‑slave with one Sentinel, dual Sentinel, and three‑Sentinel with VIP—to achieve a robust, production‑grade Redis deployment.
This article compiles essential Linux commands and a suite of Java diagnostic utilities—including tail, grep, awk, find, tsar, btrace, Greys, JProfiler, and others—providing concise examples and code snippets to help engineers troubleshoot and monitor production systems efficiently.
Tencent’s architecture platform team explains how they monitor, automate, and secure billions of daily operations across storage, CDN, and live services, using multi‑dimensional metrics, real‑time and instant computation, AI‑driven anomaly detection, and a custom control platform for safe changes.
This guide explains how to silently monitor USB insertions on a computer, automatically copy the drive’s contents to a local folder or server using a Python script that periodically scans the /Volumes directory and triggers file transfer without the user noticing.
This article clarifies that DevOps extends beyond tools like Chef or Puppet, emphasizing people, processes, and culture, and outlines the comprehensive toolchain and steps needed for full‑stack automation in modern cloud‑native environments.
This article provides a comprehensive overview of data‑center rack cabinets, covering size specifications, power and cooling requirements, key industry standards such as IEC 60297‑1 and EIA‑310‑D, structural components, environmental considerations, load capacity, and practical design guidelines for safe and efficient deployment.
This article examines Youzan's journey to containerize its development and testing environments using Kubernetes and Docker, detailing the motivations, architectural decisions, network and isolation challenges, image integration, logging, load balancing, debugging, and the ongoing rollout to standard production environments.
This article offers eight practical operations‑team strategies—inspection, monitoring alerts, capacity planning, network restrictions, risk pre‑plans, data backup, on‑call mechanisms, and staying connected—to ensure system stability and enjoy the Golden Week holiday without incidents.
This article explains the shortcomings of traditional configuration files, describes why distributed configuration centers are essential for dynamic, multi‑environment microservice deployments, outlines their evolution, presents a simple design with caching and consistency improvements, and reviews popular open‑source solutions.
Tencent’s billing platform powers billions of daily transactions across 180+ countries, supporting both consumer and business payments, and employs sophisticated capacity testing, dynamic auto‑scaling, resource sharing, and change‑control mechanisms to ensure reliable large‑scale promotional events without service disruptions.
The article provides a comprehensive overview of JD's invoice system, detailing its business lines, core modules, data sources, invoicing workflows—including forward and reverse invoicing—and the system's role in automating tax management and reducing operational risk.
Goldeneye, Alibaba Mom's monitoring platform, uses big‑data pipelines, dynamic threshold prediction, mean‑shift change‑point detection, and automated metric discovery to replace manual alarm settings, reduce false alerts, and provide intelligent, scalable business monitoring across hundreds of services.
This talk explores how ops engineers can achieve continuous professional development by adopting checklist thinking, covering growth drivers, error classification, practical checklist applications, cognitive models, and design principles that turn complex incidents into systematic, repeatable processes.
A comprehensive visual guide lists essential Linux commands covering file handling, network operations, user management, system monitoring, and more, helping administrators quickly reference and master command-line tasks.
The article investigates intermittent CPU usage spikes on Linux servers caused by a kernel cputime bug, explains the root‑cause analysis, describes a cold patch applied to newer kernels, and details a hot‑patch solution that safely resolves the issue across thousands of production machines.
This article provides a comprehensive overview of internet operations, detailing how service‑centric stability, security, and efficiency are achieved through infrastructure management, monitoring, risk mitigation, and continuous optimization, while outlining the various operational roles, their duties, and the evolution of ops practices.
Alibaba’s monitoring evolution—from fragmented early tools to the standardized Sunfire platform and now AI‑powered full‑link observability—addresses scaling challenges, introduces business‑centric metrics, automated traceability, and intelligent anomaly detection, illustrating how massive, multi‑tenant infrastructures achieve unified, proactive operations at scale.
The 2018 Global DevOps State of the World Report, compiled by DORA with contributions from leading experts, presents extensive data from over 30,000 professionals, highlights new trends such as accelerated practices, cloud infrastructure, elite high‑performance organizations, and offers a live online session to help practitioners quickly grasp its valuable findings.
On September 15, Youzan’s big-data team and NetEase YouShu hosted a technical sharing titled “The Road to Data-Driven Operations,” where speakers explored the evolution of Youzan’s data warehouse metadata system, the architecture of its big-data development platform, and the application of functional programming in visual data analysis, highlighting current trends and future directions.
This document presents a comprehensive solution for merchant settlement in joint‑venture (co‑operated) offline stores, describing business models, settlement subject abstraction, billing engine components, settlement workflow, payment collection, and reconciliation architecture with detailed tables and diagrams.
The article introduces common open‑source monitoring tools such as Zabbix and Nagios, explains why distributed systems need proactive health checks, compares features, and provides a detailed Zabbix monitoring workflow including data collection, storage, visualization, alerting, and specific metrics for servers, networks, JVM and MySQL.
