This article provides a thorough checklist covering application deployment, service governance, and cluster configuration in Kubernetes, including health probes, graceful shutdown, fault tolerance, resource limits, labeling, logging, scaling, RBAC, network policies, and compliance with CIS benchmarks.
This article explains how an operations platform can automate and streamline IT management by detailing its core value, essential components such as CMDB, monitoring, automation tools, ticketing, and analytics, and outlining implementation steps, technology choices, and advanced extensions like AI and DevOps integration.
This article explains the concept and importance of load balancing, then demonstrates a practical Docker‑Compose setup with multiple PHP containers and an Nginx reverse proxy, including configuration files and test results that show how traffic is distributed to improve system reliability and performance.
This article analyzes the shortcomings of fragmented monitoring systems, defines key metrics such as MTTA and MTTR, proposes a unified alert convergence architecture using Redis delayed queues, and details design, implementation, and future AI‑enhanced improvements to reduce alert fatigue and accelerate incident response.
This guide demonstrates how cloud disk type influences the performance of Alibaba Cloud's Kafka instances, detailing a CADT‑driven deployment, step‑by‑step load‑testing procedure, required prerequisites, and architecture overview to help users select optimal specifications.
This multi‑chapter guide provides in‑depth, hands‑on instruction for configuring and optimizing all Prometheus components, exploring Kubernetes monitoring, source‑code analysis, custom exporter development, high‑availability setups, service discovery, resource‑efficient scraping, and integrating Thanos for long‑term storage.
This article explains the role of an operations (运维) engineer, covering daily responsibilities, essential knowledge such as Linux and networking, common monitoring tools, and emerging career paths like DevOps, AIOps, and SRE, helping newcomers understand how to start and grow in the field.
This article introduces Data Envelopment Analysis (DEA) as a non‑parametric method for assessing relative efficiency of decision‑making units, explains the CCR and BCC models, and demonstrates their application in evaluating and comparing the efficiency of various U.S. cities using real‑world data.
This article introduces ten indispensable tools for operations engineers, detailing each tool's functionality, typical use cases, key advantages, and real‑world examples, helping professionals streamline automation, monitoring, configuration, and deployment tasks and improve overall system reliability.
This article introduces HertzBeat, an open‑source real‑time monitoring and alerting system that offers powerful template‑based monitoring without agents, explains its Docker‑quick start, demonstrates how to monitor Redis and SpringBoot services, and walks through email alarm configuration.
This guide outlines a systematic Linux operations troubleshooting framework—emphasizing error messages, log analysis, root‑cause isolation, and step‑by‑step solutions for six real‑world scenarios ranging from filesystem corruption to inode exhaustion and read‑only file‑system errors.
Netlify’s new AI‑assisted deployment feature automatically analyzes build failures, offers diagnostic suggestions, and helps developers resolve issues faster, though its recommendations are best‑effort and may require manual verification.
The article outlines the essential technical knowledge, team management, project management, cross‑department coordination, strategic planning, and leadership abilities required for a senior operations director to succeed and advance toward executive roles.
This guide explains why old Kubernetes clusters that use Docker can run out of disk space, describes the symptoms such as pods stuck in ContainerCreating, and provides step‑by‑step commands to clean Docker files, prune images, adjust kubelet settings, and prevent future disk‑full problems.
This guide explains Elasticsearch cluster architecture, node roles, and metadata storage, then details step‑by‑step recovery procedures for master‑node loss, complete master outage, data‑node failures, shard allocation problems, corrupted shards, translog issues, and missing segment files, including relevant API commands and tool usage.
This article examines the growing tension between traditional DevOps practices and the emerging concept of platform engineering, exploring why developers resist operational duties, the core principles of platform engineering, success factors, metrics, and future trends shaping software delivery in modern organizations.
This guide explains what frp is, why it’s a strong reverse‑proxy choice, and provides step‑by‑step instructions—including configuration files, port opening, and domain setup—to expose internal web services through custom domains securely.
This article explains the concept of graceful shutdown, outlines general steps, presents a detailed Kubernetes‑SpringBoot‑Nacos case study, discusses common pitfalls, and provides practical optimization techniques for reliable service termination in cloud‑native environments.
The two‑site three‑center disaster recovery model combines a production site, a same‑city backup, and a remote backup to ensure data integrity and rapid recovery, leveraging Oracle Data Guard for synchronized and asynchronous replication, thereby improving RPO and RTO across various disaster scenarios.
This guide explains how Docker captures container output, stores it as JSON logs, configures various log drivers, and integrates with Graylog for centralized log management, including deployment, input setup, and sending logs from containers via Docker run or docker‑compose.
This article explains how ByteDance’s BMQ, a cloud‑native message engine with a compute‑storage separated architecture, overcomes Kafka’s scalability and operational limits by using Proxy, Broker, Coordinator, and Controller modules, a distributed storage model, and advanced caching to achieve rapid scaling, high throughput, and resilient operations.
The article explains how Gartner predicts DevOps will reach production maturity by 2024‑2027, describes China CAICT's organization‑level DevOps assessment framework, its standards, classification rules, statistical results across industries, and the tangible benefits reported by participating enterprises.
This article explains how to design and implement Prometheus metrics for application monitoring, covering the selection of monitoring targets, golden metrics, label conventions, naming rules, histogram bucket choices, and Grafana visualization tricks to help engineers build reliable observability pipelines.
Software development involves both value‑creating features and unavoidable maintenance costs; this article explains how the hidden software supply chain—frameworks, libraries, runtime, cloud services, and configurations—creates consistency challenges, and proposes strategies such as explicit declarations, IaC, serverless, and mono‑repo to reduce scaling costs.
The article reflects on the relentless challenges of IT operations, outlines the never‑ending skill gaps, standards, trends and blame, and introduces a 4+1+1+1 model that separates developers, testers, security staff from four core ops responsibilities to guide systematic ops system construction.
This article explains why server reliability matters, clarifies core reliability concepts, outlines key analysis techniques, and presents practical testing and verification methods to help engineers build more dependable server systems.
Learn how to view and analyze Linux system logs using command-line utilities like journalctl and dmesg, explore key log files in /var/log, and leverage graphical tools such as GNOME Logs, KSystemLog, and Logwatch for effective troubleshooting and performance monitoring.
This guide walks through installing and configuring Prometheus, Grafana, and Node Exporter on a Linux server using Docker, shows how to set up monitoring dashboards, customize PromQL queries, and verify the monitoring system, providing complete steps and code snippets for a functional host monitoring solution.
This guide explains why systemd services often miss user environment variables like PATH and provides three practical solutions—including setting Environment= in the unit file, using a wrapper script, and configuring a global PATH—to ensure services locate commands reliably.
This guide explains why Linux servers run out of memory or disk space, how to create and enable swap files, locate and remove large or numerous small files, use soft links to expand storage, and release space held by deleted files still opened by processes.
This article introduces the core components of the ELK stack, compares three typical deployment architectures—including Logstash‑only, Filebeat‑assisted, and Kafka‑backed designs—and provides concrete configuration examples and troubleshooting tips for multiline merging, timestamp handling, and module‑level log filtering.
This article explains why effective time management is essential for developers, explores psychological, physiological, and technical dimensions, and presents practical techniques such as weekly planning, the Pomodoro method, goal‑based planning, and the Eisenhower matrix to boost productivity and work‑life balance.
This article documents a real‑world Nginx optimization case where adjusting gzip compression levels and switching to static gzip reduced CPU usage dramatically, enabling a 9‑wan QPS load to be handled with only 7% CPU and achieving over a 50‑fold performance gain.
This document provides a detailed English guide to a workflow management system, covering its underlying frameworks, feature list, process design operations, UI components, form design, deployment steps, and user interactions such as initiating, reviewing, and handling tasks.
This article details Ant Group's practical implementation of Service Level Objectives (SLO) and AIOps to achieve fine‑grained operations, covering SLO fundamentals, health‑score architecture, GitOps‑based data pipelines, error‑budget alerting, AI‑driven anomaly detection, fault localization techniques, and real‑world case studies on dashboards, Kubernetes SLOs, and emergency response workflows.
A pod in a Kubernetes cluster repeatedly restarted with exit code 137 despite staying well below its 6 Gi memory limit, prompting an investigation that uncovered the role of QoS classes, oom_score calculations, and node‑level memory pressure in the eviction process.
This guide shows how to use Zabbix to monitor database SQL results, binlog health, master‑slave replication, and how to clean up old Zabbix history with practical Bash scripts for MySQL/GreatDB and ClickHouse.
This article outlines a two‑step approach for banks to design a data governance system—clarifying organizational responsibilities and constructing a layered institutional framework—while detailing cross‑department collaboration, head‑office and branch coordination, and practical policy, procedure, and work‑detail levels to sustain continuous improvement and support digital transformation.
This article details Meituan's two‑year exploration of AIOps for incident management, covering the challenges of massive, real‑time operational data, the AI‑driven modules for risk prevention, fault detection, diagnosis, and similar‑incident recommendation, and future directions such as intelligent log detection and change recognition.
The article explains IPv4 address exhaustion, the emerging fees for public IPv4, and the technical, operational, and tooling hurdles that organizations face when transitioning to IPv6, while outlining three strategic options and real‑world migration experiences.
This article details the end‑to‑end design, node‑level splitting, metric definition, and Spring‑based implementation of SLA monitoring for a high‑volume message‑push system, showing how precise latency and vendor‑stability metrics uncovered bottlenecks, enabled rapid issue detection, and ultimately doubled overall throughput.
This article details the end‑to‑end design, implementation, and operational results of a smart customer‑service platform that automates FAQ capture, leverages both Elasticsearch and LLM‑based models, and provides a low‑code, multi‑team backend for rapid issue resolution.
This article presents a Python‑based solution that queries LogEasy data, calculates key metrics such as total requests, 5xx errors, average response time, and unique visitors, formats the results into Excel and HTML reports, and automatically sends them via email and DingTalk alerts for operational monitoring.
This article explains why message queues can become backlogged, identifies producer and consumer causes, and provides practical strategies—including adding consumers, increasing queue capacity, optimizing consumption logic, implementing failure handling, and rapid remediation steps—to quickly resolve backlog in production environments.
This comprehensive guide introduces Nginx’s high‑performance architecture, explains forward and reverse proxy concepts, demonstrates load‑balancing and static‑dynamic content separation, provides practical configuration commands, and walks through real‑world setups for reverse proxy, load‑balancing, static‑dynamic separation, and high‑availability using Keepalived.
This article provides a curated set of Bash scripts covering MySQL replication monitoring, directory change detection, bulk user creation, website health checks, remote command execution, LNMP stack deployment, server resource reporting, high‑resource process identification, and automated deployment of Java and PHP projects, offering practical automation tools for system administrators.
The 21st GOPS Global Operations Conference in Shanghai featured Shenwan Hongyuan Securities' Yusi Song presenting an in‑depth look at automated operations, covering achievements, experience summaries, and future plans, with slide images and a downloadable PPT for attendees.
This article details the practical steps and architectural choices NetEase Cloud Music took to improve RPC stability in a micro‑service environment, covering service discovery, connection management, cloud‑native challenges, SLO design, log governance, degradation, rate limiting, outlier detection, thread‑pool isolation, fast‑failure handling, registry optimizations, multi‑registry support, and post‑incident knowledge‑base building.
This guide explains how to use the stress and dd utilities together with a custom shell script to artificially consume CPU, memory, and disk resources on idle cloud servers, helping avoid budget cuts by keeping resource utilization high for a configurable period.
This article explores the design, implementation, and iterative improvement of management dashboards in fast‑moving e‑commerce data operations, covering metric system construction, product interaction, data accuracy, user experience, and common challenges with actionable solutions.
The article explains that QQ Music desktop client can unexpectedly upload large amounts of data by acting as a PCDN node, but users can easily stop this behavior by disabling the playback acceleration service in the client settings, preserving their upstream bandwidth on both Windows and Mac.
This guide explains how to create, view, edit, and design workflow processes, describes the components of the process designer—including drag‑panel, canvas, property and control panels—covers form design, deployment, process definition, request initiation, task handling, approval actions, delegation, and related source code references.
Amid a nationwide digital transformation push, four leading Chinese exchanges adopted the CAICT DevOps Capability Maturity Model, achieving multiple level‑3 and level‑2 assessments that boosted IT efficiency, integrated resources, and better supported business systems, offering valuable lessons for the industry.
This comprehensive guide covers essential Linux commands for navigating directories, managing files, controlling processes, setting permissions, using search utilities, customizing the shell, and performing common administrative tasks, providing clear examples and syntax for each operation.
Amid a nationwide digital transformation push, twelve Chinese city commercial banks adopted the CAICT‑led DevOps Capability Maturity Model, achieving higher IT efficiency, integrated resources, and faster, higher‑quality service delivery across continuous delivery, technical operations, security, and performance measurement standards.
Seven leading Chinese joint‑stock banks have evaluated a total of 62 projects against the CAICT DevOps Capability Maturity Model, revealing how continuous delivery, technical operation, security, and performance measurement standards are driving IT efficiency, cultural change, and faster value delivery across the financial sector.
This guide introduces the free, secure, and continuously updated 1Panel visual management panel for Linux servers, explains its key features, shows one‑line installation commands for CentOS and Ubuntu, and details access, security, backup, and upgrade procedures.
The article analyses why truly never‑failing systems cannot exist—citing entropy and Murphy’s laws—examines the organizational and technical obstacles to continuous high availability, and offers practical cultural and engineering practices such as testing, code review, monitoring, and regular system health checks to mitigate risk.
This guide introduces ten widely used operations engineering tools—Shell scripts, Git, Ansible, Prometheus, Grafana, Docker, Kubernetes, Nginx, ELK Stack, and Zabbix—detailing their functions, typical scenarios, advantages, and practical examples to help engineers choose the right solution for automation, monitoring, and management tasks.
This comprehensive guide compiles 35 essential Linux operations interview questions covering server management, RAID configurations, load balancing with LVS/Nginx/HAProxy, proxy choices, middleware, MySQL troubleshooting, networking tools, security practices, and practical scripts, providing concise answers to help candidates ace DevOps and sysadmin roles.
Amid China's sweeping digital, networked, and intelligent transformation, over 100 leading enterprises across banking, finance, communications, manufacturing, and other sectors have participated in DevOps and AIOps maturity model evaluations, providing a comprehensive view of industry adoption, capability levels, and emerging best practices for 2023.
This article presents Meituan's two‑year exploration of AIOps in incident management, detailing risk‑prevention change detection, real‑time anomaly discovery, automated root‑cause diagnosis, multi‑dimensional KPI analysis, and similar‑event recommendation, while sharing architectural designs, algorithmic techniques, performance results, and future directions.
Three real-world operations mishaps are recounted—a mistaken system‑time change that logged out thousands of users, an accidental bulk delete of database accounts, and a failed glibc downgrade that stalled a software release—illustrating the cascading impact of small errors and the urgent remediation steps taken.
Amid China's sweeping digital transformation, the China Academy of Information and Communications Technology (CAICT) reports that 104 leading enterprises across banking, securities, insurance, telecom, manufacturing and other sectors have completed 336 DevOps maturity assessments and 23 enterprises have finished 45 AIOps assessments in 2023, highlighting industry‑wide adoption of DevOps and AIOps standards and offering detailed breakdowns by sector, evaluation levels, and future guidance.
At the 21st GOPS Global Operations Conference in Shanghai, Shenwan Hongyuan Securities' application security lead Wang Biansi detailed a step‑by‑step 100‑day journey to create a DevSecOps sample room, covering goal setting, research, platform design, tool integration, and security training.
The article explains how combining traditional monitoring with modern observability, supported by data quality practices and unified workflows, enables more reliable, scalable, and insightful application performance management in agile and cloud‑native environments.
This article presents a detailed case study of how ZhaiZhai designed and implemented a unified monitoring platform—combining business services, middleware, and operations resources—by selecting Prometheus and M3DB, automating Grafana dashboards, creating a low‑noise alerting system, and achieving large‑scale observability with significant cost and efficiency gains.
This article explains what Apache access and error logs are, details the information they record, describes common log formats, shows where logs are stored on different operating systems, and offers guidance on analyzing and monitoring these logs for performance, security, and troubleshooting.
This article explains two practical methods—using GitHub's native release.yml configuration and the third‑party Release Drafter tool—to automatically categorize GitHub Release Notes by title, complete with example configurations, code snippets, and a comparison of their features and limitations.
This article examines how G Bank builds an application monitoring system based on ITIL and Google SRE principles, identifies its shortcomings, and evolves the platform into a visualized operations solution that aligns technical and business perspectives for faster incident resolution and improved customer experience.
The article details Bilibili's comprehensive anti‑crawling solution, covering the problem background, a two‑layer detection framework integrated with APIGW and GAIA, risk perception, strategy iteration, verification mechanisms, quantitative results, and future improvement directions, all illustrated with concrete examples and performance numbers.
This guide details how the Big Data Real‑Time Platform department organized a Bug Bash activity to train new staff, enhance cross‑product knowledge, improve product quality, and strengthen team collaboration through structured preparation, execution, and post‑event analysis.
This article walks through a real‑world Kubernetes incident where a node’s disk usage exceeded the eviction threshold, causing pods to enter the Evicted state, and details the investigation steps, root‑cause analysis, and practical remediation actions.
A developer mistakenly set a cloud disk snapshot to public, exposing a major client’s data, and recounts the frantic rollback, the ensuing panic among teammates, and the hard‑won operational lessons about high‑risk manual tasks, proper safeguards, and the need for visualized tooling.
This article explains how ByteDance's Douyin platform achieves massive concurrent user capacity by operating data centers with multi‑terabit outbound bandwidth, extensive server fleets, CDN acceleration, and dual‑link designs, providing a technical overview of its infrastructure and bandwidth estimates.
A recent e‑commerce incident caused the home page to take 20 seconds to load due to a Redis memory overload, and the team resolved it by expanding memory, redesigning data structures, and implementing a layered caching strategy with local cache, MongoDB, and fallback mechanisms.
This article details a troubleshooting investigation of a Zookeeper 3.4.6 cluster where the election port 3888 became unresponsive due to a NegativeArraySizeException triggered by malformed packets, explains the diagnostic steps, root‑cause analysis, and recommends upgrading to a newer version to fix the issue.
China Galaxy Securities detailed how three core projects passed the DevOps Continuous Delivery Level‑3 assessment, highlighting tool upgrades, process improvements, metric gains, cultural shifts, and future plans that illustrate the tangible benefits of standardized DevOps practices in a financial institution.
Meituan’s service‑operations team applies AIOps across prevention, detection, and post‑incident stages—using change‑risk analysis, real‑time graph‑based anomaly detection, similarity‑driven root‑cause diagnosis, and NLP‑powered incident recommendation—to achieve sub‑second detection, high precision, 28% faster fault handling, and plans for intelligent log and change recognition.
This article outlines how a large‑scale Kafka deployment of over a thousand machines across dozens of clusters was engineered for stability and efficiency through a custom Guardian controller that adds partition‑level throttling, automatic balancing, multi‑tenant isolation, cross‑IDC management, tiered storage, audit capabilities, and fully automated operational workflows.
This article details Bilibili's practical SLO engineering approach, covering foundational components, SLI selection, application and business level SLIs, alerting strategies, SLO‑driven quality operations, and the GOC framework for rapid fault discovery, localization, and recovery, illustrating how reliability is systematically improved.
The article details China Civil Aviation Information Network's flight management system passing the CAICT DevOps Technical Operations Level 2+ assessment, explores the interview insights on the project's design, operational improvements, and the broader significance of DevOps standards for digital transformation in the aviation industry.
Zhongtai Securities’ Centralized Operations Platform passed the CAICT DevOps Technical Operations Level‑2 assessment, showcasing how standardized DevOps practices and tool empowerment can boost quality, efficiency, and digital transformation across banking, securities, and other industries.
Five Minerals International Trust’s OGP platform passed the CAICT DevOps Continuous Delivery Level 3 assessment, marking the first trust‑industry certification in China; the interview reveals how standard‑based DevOps, team restructuring, automation, and cloud‑native architecture boosted efficiency, quality, and security.
Zhongtai Securities’ centralized operations platform recently passed the China Academy of Information and Communications Technology’s DevOps Technical Operations Level‑2 assessment, showcasing how standardized DevOps practices, tool empowerment, and rigorous evaluation can boost quality, efficiency, and digital transformation across financial institutions.
Jinzhou Bank’s mobile banking investment service microservice transformation project passed the CAICT DevOps Continuous Delivery Level 3 assessment, showcasing how standardized DevOps practices, tool empowerment, and agile adoption dramatically improved delivery speed, quality, and competitive advantage in the financial sector.
This comprehensive guide explains what e‑commerce operation entails, breaks down its six functional areas, compares internet and e‑commerce operations, and presents data‑driven tactics—including conversion funnel analysis, traffic optimization, and average order value improvement—to help businesses boost efficiency and revenue.
In a detailed interview, Five Minerals International Trust explains how its self‑developed Operations Guarantee Platform passed the CAICT DevOps Continuous Delivery Level 3 assessment, showcasing the benefits of standardized DevOps practices, improved efficiency, quality, security, and the broader impact on its digital transformation and industry adoption.
The interview reveals how FAW‑Volkswagen leveraged the CAICT DevOps maturity model to achieve Level 3 continuous delivery for its OTD order‑delivery platform and multi‑functional dealer ecosystem, detailing the standards, implementation steps, performance metrics, challenges faced, and future plans for broader digital transformation.
China Postal Savings Bank’s software R&D center detailed how its "Star Platform" earned top‑level DevOps system and tool assessments, showcasing the bank’s automation capabilities, the evaluation process, key improvements, and future plans for expanding DevOps and XOps practices across the organization.
The article examines the rapid Kubernetes upgrade cycle, the operational challenges it creates for teams, argues for a long‑term support (LTS) version, weighs pros and cons, and proposes compromise solutions to improve cluster stability without sacrificing innovation.
Five Minerals International Trust’s OGP platform passed the China Information & Communications Academy’s DevOps Continuous Delivery Level 3 assessment, showcasing how standardized DevOps practices, cloud‑native microservices, and automated pipelines can boost efficiency, quality, and security, while offering insights into the evaluation process and future plans.
The article details China’s Civil Aviation Information Network’s successful DevOps 2+ level assessment, highlighting the flight management system’s cloud‑native architecture, high‑concurrency capabilities, and the broader impact of CAICT’s DevOps standards on digital transformation across industries.
This article examines why many testing teams skip bug root‑cause analysis, outlines typical scenarios where such analysis is needed, and presents a practical four‑step method—including recording, cause marking, role attribution, and improvement planning—to enhance software quality and team efficiency.
This article explains why metrics are essential, defines what a metric is, describes the four essential elements of metric design, outlines the three‑step design process, discusses measurement scales and time characteristics, and provides criteria for evaluating good metrics.
At the 21st GOPS Global Operations Conference in Shanghai, Qunar Travel’s tech expert Zou Sheng shared a detailed hybrid‑cloud container stability practice covering IDC‑first deployment, resource utilization over 60%, phased migration, reliability improvements, AZ monitoring, and cost‑saving strategies.
This article describes Ctrip's optical transport network (TOTN) architecture, analyzes frequent fiber‑cut incidents and resulting device port flapping, presents technical research on fast optical switching and alarm delay, and details an optimization plan that achieved sub‑100 ms fault‑free switchover and stable Redis performance.
GitOps leverages Git's version‑control strengths to automate, codify, and make transparent infrastructure changes, combining IaC, merge requests, and CI/CD, while exploring its principles, toolchains like FluxCD, ArgoCD, Jenkins X, and practical implementations such as SRE Stack for end‑to‑end change management.
The article examines the rapid growth of domestic databases in China’s banking sector, identifies eight critical pain points—from product stability and resource consumption to tooling gaps and migration difficulties—and offers detailed countermeasures covering version upgrade planning, resource optimization, functional testing, skill development, monitoring, ecosystem building, data migration, and backup‑recovery improvements.
This article details the challenges of managing a complex, multi‑layered offline testing environment at KuJiaLe, outlines the standardization of baseline, functional, and integration environments, and explains the comprehensive stability measures—including infrastructure upgrades, automated checks, emergency response, and daily operations—that dramatically improved reliability.
