When a major operations incident strikes, the safest approach is to prioritize simple, low‑risk actions and accept limited responsibility, as illustrated by real DBA lessons from Oracle RAC failures and a data‑center power‑loss disaster.
This guide explains the purpose and characteristics of development, test, pre‑release, gray‑scale, and production environments, outlines deployment methods, key considerations, phased strategies, environment differences, testing data construction, and synchronization practices to improve software development quality and efficiency.
The ITU‑T Y.3525 DevOps international standard, aligned with China’s domestic DevOps evaluation, was announced on April 25, 2024, detailing its development history, evaluation scheme, upgraded certification, and the relationship with domestic standards, while showcasing industry participation data and contact information for assessments.
Amid China's digital transformation wave, the Agricultural Bank of China has leveraged the CAICT‑led DevOps Capability Maturity Model to achieve record‑setting assessments across multiple projects, demonstrating how systematic DevOps adoption can boost security, efficiency, and innovation in large financial institutions.
This guide explains how to create a shell script that checks SSL certificate expiration dates and integrates it with Zabbix by configuring a user parameter, testing the script, and setting up monitoring items, triggers, graphs, and alerts to ensure services remain available.
A Kubernetes pod repeatedly restarted with exit code 137 despite not hitting its memory limit, revealing that node‑level memory pressure and QoS‑based eviction caused the pod to be killed, and outlining how to diagnose and prevent such OOMKill events.
The article presents a comprehensive Digital Transformation Framework (DTF) for asset‑management firms, detailing how financial, economic, risk, and technical dimensions intertwine, illustrating the composable‑enterprise model, middle‑office evolution, API‑centric automation, and the essential cultural shift required for successful digital change.
This article examines Bilibili's data‑center cabling challenges and presents a smart management platform that digitizes design, automates routing with scenario‑based and shortest‑path algorithms, streamlines task creation and operation, ultimately reducing installation time and improving maintenance efficiency.
This guide presents practical Linux and vSphere techniques—including using rsync for rapid bulk file deletion, detecting newly added iSCSI disks without reboot, safeguarding rm commands, mounting remote filesystems with SSHFS, and quickly adding users to supplementary groups via gpasswd—to boost operational efficiency.
This article details Minsheng Bank’s successful achievement of Level‑3 Continuous Delivery in the CAICT DevOps maturity model, highlighting the assessment process, interview insights from senior tech leaders, measurable efficiency gains, and the broader significance of standardized DevOps practices for enterprise digital transformation.
The article explains how PCDN (P2P CDN) works, why Chinese ISPs are throttling or shutting down broadband connections that use it, and details recent regulatory responses from authorities such as the Jiangsu Provincial Communications Administration.
This article explains the concept of high availability, defines the isolation principle, outlines its implementation across various layers, and presents concrete case studies—including vertical data‑center redesign, dual‑cluster Elasticsearch migration, traffic grouping, and hot‑cold data segregation—to illustrate how isolation improves system resilience.
This article provides a comprehensive guide to Docker container management, covering how to create containers with custom commands, inspect their status and details, monitor progress and resource usage, interact with running containers, and safely start, stop, restart, or remove them using the Docker CLI.
China Southern Airlines' BTRIP and POMS projects passed the CAICT DevOps Continuous Delivery Standard, showcasing how standardized DevOps practices, agile development, CI/CD pipelines, and targeted team initiatives dramatically improved software quality, delivery speed, and operational efficiency in the airline industry.
According to a recent Linux Foundation survey of 418 IT hiring professionals, 37% of companies expanded their technical staff in 2023 while 34% maintained headcount, with cloud providers leading hiring growth, training cuts, longer onboarding times, and rising turnover concerns shaping the evolving tech talent landscape.
This article compiles multiple expert insights explaining why Linux dominates server environments, covering early Windows hosting limitations, ecosystem advantages, performance differences, cost factors, container support, and the evolution of Microsoft’s stance toward open source.
This guide walks you through checking CPU usage, system load, resource consumption, problematic processes, system logs, and performance bottlenecks on a Linux server using common command‑line tools such as top, uptime, pidstat, strace, tail, and perf.
This article analyzes the risks of incorrect B‑end link configurations in fast‑moving business environments and presents a comprehensive protection framework—including system‑level design constraints, front‑end inspections, log‑based alerts, and UI automation—to ensure link accuracy, stability, and rapid issue resolution.
This article explains how to build an offline knowledge base for IT operations by combining large language models with Retrieval‑Augmented Generation (RAG) using LangChain, covering document loading, chunking, embedding, vector storage, and query‑time retrieval with concrete code examples.
This article compiles several Zhihu contributors' perspectives on adopting Kubernetes, weighing cost, operational benefits, potential pitfalls, and practical command‑line examples to help developers decide whether container orchestration truly fits their projects.
On April 8, a Tencent Cloud API outage caused console login failures for nearly 2,000 customers, affecting several dependent services for 87 minutes, and the detailed root‑cause analysis and subsequent improvement actions are presented to enhance system resilience and change management.
On April 8, Tencent Cloud experienced a major service outage caused by a cloud API failure that prevented console login and disrupted several public cloud services for 87 minutes, prompting a detailed post‑mortem that outlines the root cause, impact, and a series of operational and change‑management improvements.
On April 8, 2024, a cloud API failure disrupted Tencent Cloud's console for 87 minutes, affecting 1,957 customers, prompting a detailed incident review that uncovered version‑compatibility and configuration‑data issues and led to a set of operational improvements.
This article introduces various Python-based data backup techniques, covering standard library modules such as shutil, zipfile, and tarfile, as well as database dump tools like pg_dump and mysqldump, and cloud storage options using awscli or boto3, with example code snippets for each method.
This guide explains how to inspect Docker disk usage, remove unused images, containers, volumes, and prune build caches with specific commands and filters, helping developers reclaim storage and keep their Docker environments clean and performant.
This article explains load balancing fundamentals, shows how to configure Nginx for a Tomcat server pool, compares common balancing algorithms, describes OSI‑layer classifications, and outlines typical scenarios such as web farms, application clusters, databases, CDN, and cloud environments.
This article explains what cache pre‑warming is, why it is essential for high‑traffic applications, and compares three practical approaches—scheduled tasks, batch loading, and manual trigger APIs—highlighting their advantages, drawbacks, and typical usage scenarios.
The article examines how a payment platform improves its 24/7 availability by preventing failures, detecting incidents in real time, and implementing rapid recovery measures such as dynamic routing, resource limits, monitoring, logging, and service degradation, while sharing practical Q&A insights.
This article explains what Site Reliability Engineering (SRE) is, outlines the three main layers of SRE work—Infrastructure, Platform, and Business—covers hiring challenges, daily duties such as deployment, on‑call, SLI/SLO management, capacity planning, user support, and offers practical interview and career advice.
The 2023 China DevOps Survey reveals that telecom operators are rapidly advancing their DevOps maturity, with over 60% achieving comprehensive maturity, driven by standardized models, continuous delivery practices, and extensive industry assessments across more than twenty sectors.
The article analyzes a recent outage of Ant's internal flash‑sale service built with AI‑generated low‑code, explains why the AI‑written business logic was not the cause, details the database capacity bottleneck that triggered a snowball effect, and discusses future automation and operational strategies to prevent similar failures.
The 2023 China DevOps Survey reveals that major securities and futures exchanges have significantly advanced their DevOps maturity, with many achieving level‑3 continuous delivery assessments, reduced delivery cycles, higher test coverage, and faster build times, illustrating the impact of digital transformation on IT efficiency.
This article compares three core system‑level high‑availability strategies—circuit breaking, degradation, and rate limiting—explaining their definitions, typical scenarios, design principles, and technical value so leaders can assess ROI and choose the right protection mechanism.
This article reviews the 2023‑2024 DevOps capability maturity assessments of six major Chinese insurance firms, highlighting their certified projects, the continuous delivery standards achieved, and how adopting the CAICT DevOps model drives faster, higher‑quality software delivery and digital transformation across the industry.
The 2023 China DevOps Survey reveals that Chinese banks are increasingly adopting DevOps to boost IT efficiency, with over 100 enterprises completing 351 assessments across multiple standards, showcasing concrete case studies of mobile banking, cloud platforms, and security initiatives that illustrate the practical impact of the CAICT DevOps maturity model.
This article describes how WeChat Pay applied chaos engineering to improve system reliability, detailing the business scenario, challenges of controlling fault injection radius, practical solutions, risk assessment, automation, and the resulting business and tool achievements.
The 2024 report details how major Chinese banks have adopted the CAICT DevOps Capability Maturity Model, showcasing assessment results across multiple standards—continuous delivery, technical operations, security, system tools, BizDevOps and efficiency measurement—highlighting improvements in agility, automation and overall IT efficiency.
This article systematically introduces monitoring fundamentals, core concepts, and architecture, then reviews three widely used open‑source monitoring tools—Zabbix, Open‑Falcon, and Prometheus—detailing their components, advantages, disadvantages, and provides practical advice for selecting the most suitable solution.
The 2023 China DevOps Status Survey reveals that state-owned banks have steadily improved their DevOps maturity, with over 100 enterprises evaluated across 20+ industries, showcasing detailed case studies, assessment results for agile development, continuous delivery, security, and performance standards that illustrate the impact of DevOps on banking digital transformation.
This article explains the concept of graceful shutdown, walks through a Kubernetes pod termination flow, demonstrates a Spring Boot + Nacos example with PreStop hooks, identifies common pitfalls, and provides practical optimizations—including MQ handling, scheduled tasks, traffic control, and actuator shutdown—to achieve reliable, zero‑downtime service termination.
This article explains why Site Reliability Engineering (SRE) emerged, outlines its core responsibilities, required skill set, and how SRE teams use SLOs, monitoring, and scenario drills to improve system reliability, performance, and observability in complex production environments.
This article explains why regular Etcd snapshots are essential for Kubernetes disaster recovery and provides detailed, command‑line procedures for restoring Etcd data on both single‑node and high‑availability clusters, including necessary configuration adjustments and verification steps.
This article compiles a set of practical Linux command‑line shortcuts—from tab completion and directory navigation to history search and log monitoring—that help both beginners and seasoned users work faster, avoid common pitfalls, and boost overall terminal productivity.
This guide explains why separate ports are normally required for multiple SSL sites, how Nginx’s SNI support lets you share a single IP and port, and provides step‑by‑step compilation and configuration examples for www, live, and vod domains.
This article compiles several Zhihu answers that explain the various operations (运维) roles—SRE, network, system, DBA and development—describe their responsibilities, challenges, and career prospects, and answer whether the work is boring and if it’s worth pursuing.
This article details how Alipay's data engineering team applied Elon Musk's five‑step work method to completely refactor a decade‑old merchant billing system, reducing overall complexity by over 60%, improving timeliness by an hour, cutting storage and compute costs by a third, and dramatically lowering operational and maintenance burdens.
This article explains the concept of graceful shutdown, demonstrates it with Kubernetes‑SpringBoot‑Nacos case studies, analyzes common issues, and provides optimization strategies such as adjusting terminationGracePeriodSeconds, using PreStop hooks, handling MQ and scheduled tasks, and leveraging actuator shutdown for reliable service termination.
This article examines Baidu's transaction middleware, detailing its multi‑layer architecture, the challenges of high‑volume, multi‑scenario payments, and the design of both near‑real‑time and T+1 offline reconciliation systems that leverage binlog listening, ETL pipelines, and big‑data technologies to guarantee data consistency across dozens of internal and external services.
This article provides a thorough checklist covering application deployment, service governance, and cluster configuration in Kubernetes, including health probes, graceful shutdown, fault tolerance, resource limits, labeling, logging, scaling, RBAC, network policies, and compliance with CIS benchmarks.
This article explains how an operations platform can automate and streamline IT management by detailing its core value, essential components such as CMDB, monitoring, automation tools, ticketing, and analytics, and outlining implementation steps, technology choices, and advanced extensions like AI and DevOps integration.
This article explains the concept and importance of load balancing, then demonstrates a practical Docker‑Compose setup with multiple PHP containers and an Nginx reverse proxy, including configuration files and test results that show how traffic is distributed to improve system reliability and performance.
This article analyzes the shortcomings of fragmented monitoring systems, defines key metrics such as MTTA and MTTR, proposes a unified alert convergence architecture using Redis delayed queues, and details design, implementation, and future AI‑enhanced improvements to reduce alert fatigue and accelerate incident response.
This guide demonstrates how cloud disk type influences the performance of Alibaba Cloud's Kafka instances, detailing a CADT‑driven deployment, step‑by‑step load‑testing procedure, required prerequisites, and architecture overview to help users select optimal specifications.
This multi‑chapter guide provides in‑depth, hands‑on instruction for configuring and optimizing all Prometheus components, exploring Kubernetes monitoring, source‑code analysis, custom exporter development, high‑availability setups, service discovery, resource‑efficient scraping, and integrating Thanos for long‑term storage.
This article explains the role of an operations (运维) engineer, covering daily responsibilities, essential knowledge such as Linux and networking, common monitoring tools, and emerging career paths like DevOps, AIOps, and SRE, helping newcomers understand how to start and grow in the field.
This article introduces Data Envelopment Analysis (DEA) as a non‑parametric method for assessing relative efficiency of decision‑making units, explains the CCR and BCC models, and demonstrates their application in evaluating and comparing the efficiency of various U.S. cities using real‑world data.
This article introduces ten indispensable tools for operations engineers, detailing each tool's functionality, typical use cases, key advantages, and real‑world examples, helping professionals streamline automation, monitoring, configuration, and deployment tasks and improve overall system reliability.
This article introduces HertzBeat, an open‑source real‑time monitoring and alerting system that offers powerful template‑based monitoring without agents, explains its Docker‑quick start, demonstrates how to monitor Redis and SpringBoot services, and walks through email alarm configuration.
This guide outlines a systematic Linux operations troubleshooting framework—emphasizing error messages, log analysis, root‑cause isolation, and step‑by‑step solutions for six real‑world scenarios ranging from filesystem corruption to inode exhaustion and read‑only file‑system errors.
Netlify’s new AI‑assisted deployment feature automatically analyzes build failures, offers diagnostic suggestions, and helps developers resolve issues faster, though its recommendations are best‑effort and may require manual verification.
The article outlines the essential technical knowledge, team management, project management, cross‑department coordination, strategic planning, and leadership abilities required for a senior operations director to succeed and advance toward executive roles.
This guide explains why old Kubernetes clusters that use Docker can run out of disk space, describes the symptoms such as pods stuck in ContainerCreating, and provides step‑by‑step commands to clean Docker files, prune images, adjust kubelet settings, and prevent future disk‑full problems.
This guide explains Elasticsearch cluster architecture, node roles, and metadata storage, then details step‑by‑step recovery procedures for master‑node loss, complete master outage, data‑node failures, shard allocation problems, corrupted shards, translog issues, and missing segment files, including relevant API commands and tool usage.
This article examines the growing tension between traditional DevOps practices and the emerging concept of platform engineering, exploring why developers resist operational duties, the core principles of platform engineering, success factors, metrics, and future trends shaping software delivery in modern organizations.
This guide explains what frp is, why it’s a strong reverse‑proxy choice, and provides step‑by‑step instructions—including configuration files, port opening, and domain setup—to expose internal web services through custom domains securely.
This article explains the concept of graceful shutdown, outlines general steps, presents a detailed Kubernetes‑SpringBoot‑Nacos case study, discusses common pitfalls, and provides practical optimization techniques for reliable service termination in cloud‑native environments.
The two‑site three‑center disaster recovery model combines a production site, a same‑city backup, and a remote backup to ensure data integrity and rapid recovery, leveraging Oracle Data Guard for synchronized and asynchronous replication, thereby improving RPO and RTO across various disaster scenarios.
This guide explains how Docker captures container output, stores it as JSON logs, configures various log drivers, and integrates with Graylog for centralized log management, including deployment, input setup, and sending logs from containers via Docker run or docker‑compose.
This article explains how ByteDance’s BMQ, a cloud‑native message engine with a compute‑storage separated architecture, overcomes Kafka’s scalability and operational limits by using Proxy, Broker, Coordinator, and Controller modules, a distributed storage model, and advanced caching to achieve rapid scaling, high throughput, and resilient operations.
The article explains how Gartner predicts DevOps will reach production maturity by 2024‑2027, describes China CAICT's organization‑level DevOps assessment framework, its standards, classification rules, statistical results across industries, and the tangible benefits reported by participating enterprises.
This article explains how to design and implement Prometheus metrics for application monitoring, covering the selection of monitoring targets, golden metrics, label conventions, naming rules, histogram bucket choices, and Grafana visualization tricks to help engineers build reliable observability pipelines.
Software development involves both value‑creating features and unavoidable maintenance costs; this article explains how the hidden software supply chain—frameworks, libraries, runtime, cloud services, and configurations—creates consistency challenges, and proposes strategies such as explicit declarations, IaC, serverless, and mono‑repo to reduce scaling costs.
The article reflects on the relentless challenges of IT operations, outlines the never‑ending skill gaps, standards, trends and blame, and introduces a 4+1+1+1 model that separates developers, testers, security staff from four core ops responsibilities to guide systematic ops system construction.
This article explains why server reliability matters, clarifies core reliability concepts, outlines key analysis techniques, and presents practical testing and verification methods to help engineers build more dependable server systems.
Learn how to view and analyze Linux system logs using command-line utilities like journalctl and dmesg, explore key log files in /var/log, and leverage graphical tools such as GNOME Logs, KSystemLog, and Logwatch for effective troubleshooting and performance monitoring.
This guide walks through installing and configuring Prometheus, Grafana, and Node Exporter on a Linux server using Docker, shows how to set up monitoring dashboards, customize PromQL queries, and verify the monitoring system, providing complete steps and code snippets for a functional host monitoring solution.
This guide explains why systemd services often miss user environment variables like PATH and provides three practical solutions—including setting Environment= in the unit file, using a wrapper script, and configuring a global PATH—to ensure services locate commands reliably.
This guide explains why Linux servers run out of memory or disk space, how to create and enable swap files, locate and remove large or numerous small files, use soft links to expand storage, and release space held by deleted files still opened by processes.
This article introduces the core components of the ELK stack, compares three typical deployment architectures—including Logstash‑only, Filebeat‑assisted, and Kafka‑backed designs—and provides concrete configuration examples and troubleshooting tips for multiline merging, timestamp handling, and module‑level log filtering.
This article explains why effective time management is essential for developers, explores psychological, physiological, and technical dimensions, and presents practical techniques such as weekly planning, the Pomodoro method, goal‑based planning, and the Eisenhower matrix to boost productivity and work‑life balance.
This article documents a real‑world Nginx optimization case where adjusting gzip compression levels and switching to static gzip reduced CPU usage dramatically, enabling a 9‑wan QPS load to be handled with only 7% CPU and achieving over a 50‑fold performance gain.
This document provides a detailed English guide to a workflow management system, covering its underlying frameworks, feature list, process design operations, UI components, form design, deployment steps, and user interactions such as initiating, reviewing, and handling tasks.
This article details Ant Group's practical implementation of Service Level Objectives (SLO) and AIOps to achieve fine‑grained operations, covering SLO fundamentals, health‑score architecture, GitOps‑based data pipelines, error‑budget alerting, AI‑driven anomaly detection, fault localization techniques, and real‑world case studies on dashboards, Kubernetes SLOs, and emergency response workflows.
A pod in a Kubernetes cluster repeatedly restarted with exit code 137 despite staying well below its 6 Gi memory limit, prompting an investigation that uncovered the role of QoS classes, oom_score calculations, and node‑level memory pressure in the eviction process.
This guide shows how to use Zabbix to monitor database SQL results, binlog health, master‑slave replication, and how to clean up old Zabbix history with practical Bash scripts for MySQL/GreatDB and ClickHouse.
This article outlines a two‑step approach for banks to design a data governance system—clarifying organizational responsibilities and constructing a layered institutional framework—while detailing cross‑department collaboration, head‑office and branch coordination, and practical policy, procedure, and work‑detail levels to sustain continuous improvement and support digital transformation.
This article details Meituan's two‑year exploration of AIOps for incident management, covering the challenges of massive, real‑time operational data, the AI‑driven modules for risk prevention, fault detection, diagnosis, and similar‑incident recommendation, and future directions such as intelligent log detection and change recognition.
The article explains IPv4 address exhaustion, the emerging fees for public IPv4, and the technical, operational, and tooling hurdles that organizations face when transitioning to IPv6, while outlining three strategic options and real‑world migration experiences.
This article details the end‑to‑end design, node‑level splitting, metric definition, and Spring‑based implementation of SLA monitoring for a high‑volume message‑push system, showing how precise latency and vendor‑stability metrics uncovered bottlenecks, enabled rapid issue detection, and ultimately doubled overall throughput.
This article details the end‑to‑end design, implementation, and operational results of a smart customer‑service platform that automates FAQ capture, leverages both Elasticsearch and LLM‑based models, and provides a low‑code, multi‑team backend for rapid issue resolution.
This article presents a Python‑based solution that queries LogEasy data, calculates key metrics such as total requests, 5xx errors, average response time, and unique visitors, formats the results into Excel and HTML reports, and automatically sends them via email and DingTalk alerts for operational monitoring.
This article explains why message queues can become backlogged, identifies producer and consumer causes, and provides practical strategies—including adding consumers, increasing queue capacity, optimizing consumption logic, implementing failure handling, and rapid remediation steps—to quickly resolve backlog in production environments.
This comprehensive guide introduces Nginx’s high‑performance architecture, explains forward and reverse proxy concepts, demonstrates load‑balancing and static‑dynamic content separation, provides practical configuration commands, and walks through real‑world setups for reverse proxy, load‑balancing, static‑dynamic separation, and high‑availability using Keepalived.
This article provides a curated set of Bash scripts covering MySQL replication monitoring, directory change detection, bulk user creation, website health checks, remote command execution, LNMP stack deployment, server resource reporting, high‑resource process identification, and automated deployment of Java and PHP projects, offering practical automation tools for system administrators.
The 21st GOPS Global Operations Conference in Shanghai featured Shenwan Hongyuan Securities' Yusi Song presenting an in‑depth look at automated operations, covering achievements, experience summaries, and future plans, with slide images and a downloadable PPT for attendees.
This article details the practical steps and architectural choices NetEase Cloud Music took to improve RPC stability in a micro‑service environment, covering service discovery, connection management, cloud‑native challenges, SLO design, log governance, degradation, rate limiting, outlier detection, thread‑pool isolation, fast‑failure handling, registry optimizations, multi‑registry support, and post‑incident knowledge‑base building.
This guide explains how to use the stress and dd utilities together with a custom shell script to artificially consume CPU, memory, and disk resources on idle cloud servers, helping avoid budget cuts by keeping resource utilization high for a configurable period.
This article explores the design, implementation, and iterative improvement of management dashboards in fast‑moving e‑commerce data operations, covering metric system construction, product interaction, data accuracy, user experience, and common challenges with actionable solutions.
The article explains that QQ Music desktop client can unexpectedly upload large amounts of data by acting as a PCDN node, but users can easily stop this behavior by disabling the playback acceleration service in the client settings, preserving their upstream bandwidth on both Windows and Mac.
This guide explains how to create, view, edit, and design workflow processes, describes the components of the process designer—including drag‑panel, canvas, property and control panels—covers form design, deployment, process definition, request initiation, task handling, approval actions, delegation, and related source code references.
