This article explains how Tencent Game operations moved from manual, threshold‑based monitoring to an AI‑powered, data‑driven workflow that automates scaling, improves online‑curve monitoring, enables full‑dimensional analysis, and reduces time, labor, and cost while enhancing player experience.
This article explains the DevOps methodology, its goals of rapid high‑quality software delivery and cost reduction, and details how the Telad Cloud Platform implements end‑to‑end automation—including CI, automated testing, packaging, deployment, and continuous delivery using Microsoft TFS and custom tools.
iQiyi monitors video buffering across millions of users, classifies anomalies into internal, server, operator, and user causes, uses a buffer perception system with clustering and SVM predictions, automates multi‑dimensional alerts, and resolves over 93% of non‑operator incidents within 15 minutes.
This article details Qunar's end‑to‑end hardware automation system, covering background challenges, lifecycle management, automated testing, data collection, fault detection, and visualized monitoring, and explains how the integrated platform reduces manual effort, improves reliability, and cuts operational costs.
This article compiles 22 practical recommendations from an operations manager covering domain management, CDN usage, image servers, data center selection, monitoring, security, redundancy, high‑availability architecture, disaster‑recovery planning, and team coordination to help ensure stable and secure online services.
In this reflective piece, Zhao Cheng (aka Qianyi) shares his experience managing the operations team at Mogujie, argues that operations value extends beyond automation to efficiency, stability, security, cost, and user experience, and offers practical guidance for shifting mindsets and aligning ops with business goals.
This article details a step‑by‑step transformation of an internet finance platform's online release process, covering application architecture, public component selection, smooth deployment techniques using Dubbo weight adjustment, RocketMQ control, LTS task isolation, verification methods, and a comprehensive gray‑release strategy with practical pitfalls and future improvements.
Reflecting on ten years of DevOps, this article traces its origins, examines enduring obstacles such as reliability, coordination, and cultural resistance, highlights early success stories like Flickr, and argues that the future of DevOps depends on solid toolchains rather than abstract cultural shifts.
This article chronicles Ctrip's multi‑year architectural evolution—covering operations, framework, application layers, publishing system, configuration management, SOA, and the large‑scale UserProfile project—highlighting the motivations, challenges, and solutions that shaped its high‑availability, high‑performance platform.
The article examines the rise of unmanned stores in China, classifies them into five technology levels from L0 to L4, and discusses their current capabilities, challenges, and future prospects as shared by industry expert Xiang Jiangxu.
This article explains website availability metrics, fault‑weight scoring, layered high‑availability architecture, session management strategies, reusable service design, data redundancy, quality assurance processes, and monitoring practices essential for maintaining reliable large‑scale web systems.
A detailed case study reveals how an out‑of‑memory (OOM) situation on a Linux server caused Tomcat to crash during load testing, explains the kernel's OOM killer behavior, and provides practical solutions such as enabling swap and tuning Apache limits.
This article details how Tencent's SNG operations team leveraged the ZhiYun intelligent operations platform—through standardized processes, massive IaaS provisioning, CMDB management, automated workflows, and real‑time capacity monitoring—to support the high‑traffic “Military Photo” H5 campaign, scaling up to 4,000 servers and 24 GB bandwidth.
Based on interviews with 16 senior executives from 14 companies, this article highlights that DevOps success hinges on people, process, and technology, emphasizing cultural change, automation, faster releases, higher quality, and the growing impact of cloud and containers on future development practices.
Drawing from a year‑and‑a‑half of ops experience, this guide outlines six practical categories—online operation standards, data handling, security, daily monitoring, performance tuning, and mindset—to help engineers avoid costly mistakes and maintain stable, secure systems.
This guide explains how to set up JMeter’s PerfMon plugins for both GUI and non-GUI server performance monitoring, including required plugin downloads, agent installation, JAR placement, test plan configuration, command-line execution, and result analysis.
This tutorial introduces Sysdig, an open‑source Linux monitoring tool that combines strace, tcpdump, and lsof, shows how to install it, explore its built‑in chisels, and apply practical examples for performance troubleshooting, user activity, file I/O, and network traffic analysis.
This article shares practical SRE‑based principles and step‑by‑step methods for diagnosing and resolving online incidents, emphasizing mindset, systematic information gathering, and structured analysis to turn mysterious outages into solvable problems.
This article chronicles the evolution of Sina's news comment platform from its early Perl‑based prototype through versions 3.0, 4.0, and 5.0, detailing architectural choices, caching strategies, database sharding, asynchronous processing, and the eventual migration to cloud‑native Python services to handle massive traffic spikes.
This article introduces ChatOps, explains its relationship to DevOps, reviews popular open‑source implementations such as Hubot, Lita and Err, and provides practical advice on robot integration, command design, common pitfalls, and how to build a collaborative chat‑based operations workflow.
This article curates a comprehensive list of essential Linux and related technology books, ranging from beginner guides and system fundamentals to advanced topics like kernel development, cloud computing, security, and automation, helping aspiring sysadmins and engineers build a solid knowledge foundation.
This article reviews Ctrip's two‑year architecture transformation, describing how the company replaced hardware load balancers with a software‑defined SLB, introduced application‑level grouping, multi‑update mechanisms, health‑check sharing, monitoring, and the TARS release platform to achieve faster, more reliable deployments.
This guide explains how to fine‑tune Linux kernel parameters and NGINX directives—such as backlog queues, file descriptors, worker processes, keep‑alive settings, access‑log buffering, sendfile, and request limits—to achieve optimal web server performance for high‑traffic sites.
This guide outlines the core Linux system fundamentals, networking services, scripting languages, text‑processing utilities, database handling, firewall configuration, monitoring solutions, clustering, and backup techniques that form the essential toolkit for aspiring Linux operations engineers.
This article presents a comprehensive overview of fault governance in large‑scale distributed systems, covering classic dependency failures, the concept of strong and weak dependencies, experimental observations, the evolution of fault‑injection techniques, and best practices for building reliable fault‑drill platforms.
This guide presents a comprehensive collection of Python's os and shutil functions, file handling methods, and practical code examples to help operations engineers automate tasks, manage files and directories, and improve efficiency in modern IT environments.
The author recounts attending a Phoenix Project‑based DevOps simulation in Beijing, describing role misunderstandings, the use of Kanban boards, bottleneck handling, one‑piece flow, and communication challenges, and concludes with recommendations on who should participate in such training.
This article compiles an extensive collection of architecture knowledge maps and a detailed overview of DevOps tools, categorizing them by development, deployment, and maintenance functions while also presenting related big‑data and cloud‑computing skill maps for engineers seeking a holistic view of modern software infrastructure.
This article shares practical insights from Google SRE on on‑call duty, covering why on‑call is needed, common challenges, effective scheduling, evaluation methods, and actionable tips to improve team resilience and reduce stress for operations engineers.
The article explains how enterprises can quantify the commercial benefits and return on investment of DevOps by examining adoption statistics, business outcomes, success criteria for CEOs, CIOs and team leads, and key performance metrics that demonstrate the impact on cost, speed, and reliability.
The article uses martial‑arts metaphors to explore how operations engineers should master fundamentals, combine inner knowledge with practical skills, leverage tools, embrace teamwork, and automate processes to deliver higher business availability with lower cost.
The article explores the intense workload, rapid response demands, and compensation realities of game operations, highlighting how automation and deep business knowledge can reduce overtime while stressing the need for continuous skill development to sustain a viable career in the gaming industry.
This guide compiles essential Linux command‑line techniques—from searching and editing with vi/vim, using pipelines, file finding, string replacement, redirection, permission changes, to monitoring system resources and network connections—helping operations engineers boost productivity and maintain high service availability.
The article shares practical operations lessons—from periodic permission audits and thorough documentation to capacity monitoring, log rotation, and automation—illustrating how systematic practices and tooling can standardize and streamline IT infrastructure management.
Rancho is a unified release platform built for Panda Live that streamlines project onboarding, enforces multi‑layer security through SSO, user and project permissions, provides a web‑based front‑end and back‑end for tag selection, environment mapping, automated deployment, audit logging, and rollback, dramatically reducing release cycles.
This article explains how JMeter implements its various distributed testing modes, examines the SampleSender interface and its overloads for standard, batch, and asynchronous modes, and presents optimization techniques that reduce network overhead and improve overall load‑testing performance.
This article explains why disk health monitoring is crucial for service stability, introduces SMART technology and the smartctl tool, details command usage, key SMART attributes, value interpretation, and outlines automated data collection and alerting strategies for reliable operations.
This article outlines a comprehensive, multi‑layered security framework for operations teams, covering policy design, dual‑account permission separation, grid‑based vulnerability management, topology and network safeguards, OS and database hardening, common misconceptions, and actionable principles for maintaining robust protection.
This article outlines Ctrip’s evolving architecture—covering its operational backbone, framework components, release system, configuration management, SOA evolution, and the massive UserProfile big‑data platform—offering practical insights from a senior developer on how the company achieves high availability and scalability.
The article explains how salt‑minion’s DNS resolution can become stale after a data‑center migration because each Linux process caches resolver settings in a private _res structure initialized by glibc’s res_init(), and it offers practical ways to force a refresh or redesign the lookup mechanism.
This article explains why continuous testing is essential for effective DevOps, describing its role in feedback loops, key performance metrics, testing frameworks, and how automated testing drives quality and rapid delivery across development, QA, and operations.
This article, based on a DevOpsDays talk, explains practical shell‑script techniques—adding logging, usage help, file locking, and clear comments—to make MySQL backup scripts reliable, maintainable, and safe for collaborative operations environments.
This article introduces the fundamentals of time‑series databases, compares them with traditional databases, surveys industry adoption, and details how Tiger Live leverages OpenTSDB, Grafana, and Bosun to build a scalable monitoring system for live‑streaming services.
This interview chronicles Xiao Li’s unconventional path from a petroleum chemistry graduate to a senior operations director, highlighting his hands‑on experience with system administration, virtualization, cloud computing, and team management across major Chinese tech firms.
This article outlines the service‑centric principles of internet operations, details the various categories of work such as system, application, database, and security operations, and traces the evolution of operational practices from manual management to automated, platform‑driven workflows.
This guide outlines how operations engineers can elevate their professional image by pursuing key certifications, mastering deep technical topics, favoring niche tools over mainstream ones, writing scripts with awk/sed, embracing unconventional operating systems, and strategically networking within the industry.
The article describes how a small development team adopts a three‑week periodic release cadence, improves demand management, resolves operational concerns, and standardizes configuration, environment, deployment, and testing processes to achieve continuous delivery with higher quality and lower coordination cost.
This article explores how Tencent’s operations team redefines its value by applying fine‑grained technical management to mobile internet challenges, capacity planning, bandwidth optimization, and data‑driven product decisions, ultimately delivering huge cost savings and turning operations into a core competitive advantage.
The article examines how Barclays bank undertook an 18‑month enterprise‑wide agile and DevOps transformation—spanning IT, HR, security, and all business units—to meet FinTech competition, improve speed, reliability, and support a large‑scale digital overhaul for the financial sector.
The article examines the challenges of selecting hardware and monitoring tools, comparing Intel CPUs on performance versus price, and outlines criteria for evaluating bypass‑monitoring products, emphasizing cost, reliability, scalability, and data‑decoding capabilities to guide informed operational decisions.
This article details Tencent's operation automation for the 2016 Chinese New Year QQ red‑packet activity, describing the massive traffic challenge, the architectural design, the shift from manual to CMDB‑driven one‑click scaling, load‑testing, flexible protection strategies, and on‑site monitoring that enabled rapid, reliable handling of billions of red‑packet transactions.
This article traces the evolution of DevOps from its early roots in agile development and the challenges faced by developers and operations teams, through community formation, industry adoption, and the rise of cloud‑native technologies that have shaped modern continuous delivery practices.
This article details Alibaba's evolution of its operations platform, describing the design, features, and performance of StarAgent, the Qingteng P2P file distribution system, and the Normandy application‑deployment platform, highlighting how these tools enable high‑availability, automation, and massive scalability across global data centers.
This article presents a comprehensive overview of Ctrip's evolving system architecture, detailing its operational strategies, framework components such as SOA and release systems, and the large‑scale UserProfile big‑data platform, illustrating how each iteration addressed prior challenges while introducing new capabilities.
This tutorial walks you through using PSSH and PSCP for parallel command‑line deployments, establishing SSH trust, packaging and uploading files, handling branch selection, environment targeting, and safe rollback, all illustrated with real‑world examples and code snippets.
This guide outlines the ten core toolsets—ranging from Linux basics and network services to scripting, firewalls, monitoring, clustering, and backup—that aspiring Linux operations engineers need to master for effective system administration.
From early manual deployments to a sophisticated, multi-layered monitoring stack—including ELK, Zabbix, Statsd, Grafana, and Prometheus—Bilibili’s ops team shares the evolution, challenges, and lessons learned in building scalable, automated infrastructure for massive internet traffic.
This article explains the fundamentals of monitoring, distinguishes traditional OPS from SRE perspectives, defines monitoring objects and metrics, introduces quantitative thinking with SLI/SLO, and presents the USE method with a MySQL example to help engineers detect and prevent failures efficiently.
This article walks through the hardware and software preparation, configuration, deployment, testing, and troubleshooting steps required to set up a Ceph distributed block storage cluster on CentOS 7, including node roles, RAID setups, and Ceph‑deploy commands.
This article describes the background, design concepts, selection rationale, implementation principles, algorithm details, and configuration of a Lua‑based overload protection module for Nginx that monitors system load and dynamically rejects traffic to safeguard backend services.
This article explains Alibaba's four‑step capacity‑planning methodology, the various single‑machine load‑testing techniques, the design of a full‑link load‑testing platform for Double‑11, and the dynamic flow‑control framework that together ensure system stability during extreme traffic spikes.
This article explains why the Linux commands df and du often report different disk usage figures, detailing three main causes—reserved space, phantom (deleted) files, and data present before mounting—and provides concrete commands and steps to identify and resolve each discrepancy.
This article recounts how the 2013 HULK private‑cloud team evolved their operations from manual, repetitive tasks to a fully productized, automated platform, detailing two major upgrades—tooling automation and product‑oriented services—while sharing practical insights on monitoring, alarm management, and user‑centric design.
This article explains the concepts of distributed clusters and load balancing, contrasting clusters and distributed systems with real‑world analogies, describing various load‑balancing techniques such as DNS, LVS, and reverse proxies, and offers practical guidance on designing simple, reliable, and efficient load‑balancing solutions for distributed back‑ends.
The article presents a visual recap of Patrick Debois' DevOpsDays Austin presentation, illustrating the history, culture, practices, challenges, and future directions of DevOps through a series of themed paintings and captions that highlight automation, measurement, feedback loops, and the human side of the movement.
This article outlines a comprehensive methodology for handling large‑scale online service incidents, covering goals, the "jump‑fill‑avoid" framework, step‑by‑step processes for detection, diagnosis, remediation, and post‑mortem analysis, as well as essential monitoring, logging, and escalation infrastructure.
This article recounts Alibaba's middleware team's QCon Beijing 2017 presentation on fault governance and fault‑drill practices, covering distributed‑system dependency failures, strong/weak dependency concepts, multi‑stage technical evolution, and the design of their chaos‑engineering platform for large‑scale e‑commerce.
This article analyzes how operations engineers in Beijing progress from entry‑level salaries of a few thousand yuan to senior roles earning over thirty thousand, by examining job postings, required skills, and experience levels to map a clear career growth path.
This article explains what DevOps is, contrasts it with traditional development‑operations workflows, discusses its benefits and drawbacks, outlines key challenges such as balancing efficiency with stability, responsibility allocation, and assessment, and presents four metrics for evaluating DevOps effectiveness.
This article describes the architecture, deployment, configuration, maintenance, and performance results of a large‑scale near real‑time logging platform built with Kafka, Flume, and Elasticsearch, highlighting practical lessons and future plans for resource‑efficient operation.
This article introduces the widely used F5 load‑balancing appliance, detailing its front‑panel indicators, network interfaces, status LEDs, and step‑by‑step procedures for initial web‑based configuration, including default IP, login credentials, and essential system settings such as hostname and root password policies.
This article introduces a straightforward DevOps implementation framework that maps eleven essential service capabilities across the software development lifecycle, explains why adopting DevOps is a multi‑year journey, and uses a fitness analogy to illustrate how enterprises can progressively build these capabilities.
This article outlines the rationale for adopting Node.js in the 京友邦 project, compares two deployment architectures—separate Node and Tomcat services versus co‑locating them in a single Docker container—and provides detailed step‑by‑step instructions for packaging, scripting, Nginx configuration, and monitoring to achieve a successful rollout.
The article examines why IoT purchases are decentralized across IT, business, and operations units, identifies the true buyers, explains how IoT differs from traditional IT, and offers six practical best‑practice steps for vendors to successfully sell IoT solutions within complex enterprise environments.
The article explains Agile software development, Continuous Integration, DevOps, and Continuous Delivery, examines their inter‑relationships from both technical and human perspectives, and offers practical steps, maturity models, and real‑world case insights for teams seeking faster, reliable software delivery.
The article explains how the Architecture Platform team builds a comprehensive, automated operations system—including CMDB, cost budgeting, monitoring, permission management, self‑service tools, and mobile access—to safely and efficiently manage tens of thousands of servers and massive storage services.
This article explains how security professionals can adopt DevOps practices—such as cross‑functional collaboration, continuous delivery, and visualized security status—to build a resilient security architecture that aligns with agile development and reduces risk through frequent, small releases.
This article details Tencent's large‑scale live streaming architecture for NBA games, covering the rapid growth of live video, key technical features, network transmission challenges, multi‑angle production, CDN deployment, monitoring, big‑data processing, and strategies for ensuring low latency and high reliability for millions of concurrent viewers.
The article describes how a development team transitioned to short‑cycle, periodic releases, outlining the goals, benefits, operational concerns, and a comprehensive set of improvements—including testing strategy, configuration and environment management, and automated deployment pipelines—to maintain quality while increasing release frequency.
The article explains Kafka’s default consumer offset storage mechanism, why the __consumer_offsets system topic can consume massive disk space due to frequent synchronous commits and misconfigured cleanup, and outlines practical steps to reduce offset data and enable proper log compaction.
The article examines how the shared‑economy mindset is transforming data‑center infrastructure—from modular designs and integrated solutions to new business models—driving lower costs, higher efficiency, and a shift from construction‑focused to operation‑focused competition across the entire ecosystem.
This article explains how Nginx can function as a reverse proxy, load balancer, HTTP server with static‑file handling, and forward proxy without relying on third‑party modules, providing configuration examples and discussing built‑in load‑balancing strategies such as round‑robin, weight, ip_hash, fair, and url_hash.
This guide explains how to configure Zabbix log monitoring using log and logtr keys, details each parameter, describes the monitoring mechanics, and shows how to set up items and view results, enabling reliable detection of specific log patterns.
This article explains how to analyze and visualize Docker container logs using the ELK stack, covering preparation, parsing tips, Kibana query techniques, and example visualizations to help monitor Dockerized environments effectively in production.
Li Qiang, Operations Director at TianpiaoChe, shares the step‑by‑step transformation of a legacy e‑commerce infrastructure, covering network latency fixes, hardware re‑allocation, OS tuning, open‑source component upgrades, virtualization changes, and future plans, providing practical insights for large‑scale site operations.
This article outlines a practical operations learning path, comparing CentOS 6 and 7, recommending foundational skills across OS, web services, databases, load balancing, caching, NoSQL, storage, version control, monitoring, and scripting to help engineers stay current and effective.
The Meituan‑Dianping technical salon showcases its DevOps automation philosophy by presenting three core tools—DB automation platform, service tree, and Puppet web management—while also featuring Shanghai Zhaogang Network’s CMDB experience, illustrating how rapid O2O growth drives the need for fast, reliable, and scalable operational automation.
This article explains Greenplum's MPP architecture, master‑segment design, high‑availability, interconnect network, rich management tools, parallel query planning, data loading techniques, and additional capabilities such as LDAP authentication and resource queues, demonstrating why it is a strong next‑generation big‑data query engine.
This article recounts the Huajiao team's migration from PHP 5 to PHP 7, detailing the motivations, upgrade hurdles, extensive performance benchmarks, gray‑release strategy, and operational steps that together delivered up to 30% CPU savings and significant cost reductions.
This guide walks through installing pnp4nagios on CentOS 6.8, configuring required packages, compiling the software, testing the installation, understanding its bulk mode with npcd, and adjusting Nagios and pnp4nagios settings to enable dynamic performance graphs.
This article explains why availability and reliability are critical for web APIs, outlines four common rate‑limiting techniques used at Stripe, describes how to choose and implement request, concurrent, usage‑based, and worker‑utilization limiters, and provides practical guidance for safely deploying them in production.
This article explains the concept of Site Reliability Engineering (SRE), its origins at Google, core responsibilities such as IT operations and availability improvement, required skill sets, how it differs from DevOps, and guidance on adopting SRE practices within organizations.
At QCon Beijing 2017, three senior Baidu Waimai engineers detailed the company’s year‑long migration from IDC to cloud using custom operation platforms, described the AI‑driven, data‑rich logistics scheduling system that outperforms manual dispatch, and shared architectural evolutions that enabled rapid, zero‑downtime scaling of the fast‑growing delivery business.
The article details Hulu's evolution from a simple web video service to a multi‑device platform, highlighting the scalability, micro‑service architecture, DASH streaming, and comprehensive quality monitoring that enable consistent live streaming experiences across diverse US devices.
This article outlines a comprehensive solution for mobile game operations, covering the value of modern ops, user‑experience metrics across download, login, gameplay, payment and sentiment, download‑service optimizations such as domain and resource hijack protection, incremental updates, and real‑time battle network enhancements including access‑network, backbone and QoS techniques.
The article explains Baidu's traditional project branch management approach, the reasons behind mainline release queues, and summarizes the team's continuous delivery transformation, highlighting clear goals, transparent planning, self‑defined processes, story‑driven development, six‑step CI, and automated testing practices.
This step‑by‑step guide shows how to prepare two Tomcat servers, create a simple web project, configure Nginx as a reverse‑proxy load balancer with various strategies, start the services on Windows, and verify that requests are distributed across the Tomcat instances.
This article presents a comprehensive methodology for internet performance engineering, covering non‑functional quality goals, detailed metrics for application servers, databases, caches and message queues, a practical technical review outline, and a real‑world capacity‑planning case study with both maximal and minimal resource solutions.
This article presents a comprehensive methodology for reviewing internet‑scale system architectures, focusing on non‑functional quality attributes such as performance, availability, scalability, security, and maintainability, and provides detailed guidelines, metrics tables, and a classic case study for capacity and performance planning.
This comprehensive guide explains why monitoring is vital for operations, outlines clear objectives and methods, compares popular open‑source and commercial tools, details a Zabbix‑based workflow, and covers hardware, system, application, network, security, API, performance, and business metrics with practical alerting strategies.
