This guide presents essential kubectl commands for creating and managing Deployments, Pods, Services, and Ingresses, checking cluster and node status, running container applications, updating images and resource limits, and handling log collection and monitoring in a Kubernetes environment.
The October 23 Yuque outage, caused by a buggy upgrade tool and outdated storage hardware, highlighted the importance of thorough testing, robust disaster‑recovery, high‑availability architecture, clear communication, continuous learning, and applying the KISS principle to simplify complex systems and improve operational stability.
Dongguan Securities’ ‘Zhangzhengbao Service Platform’ passed the China Information and Communication Research Institute’s DevOps Capability Maturity Model Level‑3 Continuous Delivery assessment, showcasing how standardized DevOps practices, automated pipelines, and micro‑service architecture dramatically improved development efficiency, code quality, and operational agility, positioning the firm as a domestic leader in financial technology.
This article outlines practical steps, challenges, and results of implementing data table compliance governance in a fast‑growing data warehouse, covering standards redefinition, decommissioning unused tables, metric reuse, ODS penetration reduction, and ongoing maintenance strategies.
Zhejiang Rural Commercial Bank’s two flagship projects passed the Level‑3 Continuous Delivery assessment, showcasing how standardized DevOps practices, tool empowerment, and agile transformation can dramatically improve software quality, delivery speed, and overall competitiveness in the banking sector.
This article details Zhengzhou Commodity Exchange’s technology company's successful DevOps continuous‑delivery Level 3 assessment, sharing interview insights, performance metrics, implementation challenges, and future plans that illustrate how standardized, automated DevOps practices boost delivery speed, quality, and digital transformation.
The article outlines eBay’s key scalability best practices—including functional partitioning, horizontal sharding, eliminating distributed transactions, aggressive asynchronous decoupling, intelligent caching, and pervasive virtualization—to illustrate how large‑scale web systems can achieve linear or sub‑linear growth while maintaining availability and performance.
This guide explains Loki's core concepts, deployment steps for Promtail and Loki, Grafana integration, label‑based indexing, handling dynamic and high‑cardinality tags, and query optimization techniques, providing a complete roadmap for building a cost‑effective, scalable log aggregation system.
This article examines the rapid growth of the Chinese IT operations market, explains why AIOps faces trust challenges due to opaque deep‑learning models, and presents AsiaInfo's transparent‑model and post‑hoc explanation engine together with three concrete explainable root‑cause analysis methods, concluding with future outlooks for trustworthy AIOps.
This guide explains the concepts of ZooKeeper cluster roles and provides step‑by‑step instructions, including configuration file edits and command‑line operations, to set up a pseudo‑cluster on a single machine for testing and learning purposes.
This article walks through practical methods for troubleshooting slow service alerts, diagnosing Redis performance bottlenecks, and reproducing issues with local demos and load simulations, offering concrete metrics, command‑line checks, and mitigation strategies such as scaling, rate‑limiting, and pipeline optimization.
This article explains Memcached’s architecture, key characteristics, suitable and unsuitable scenarios, memory management and LRU mechanisms, version details, and provides a comprehensive guide to monitoring its performance and health using Prometheus and Alibaba Cloud ARMS dashboards.
This guide explains why monitoring systems need self‑monitoring, how to leverage their own /metrics endpoints for internal health checks, and how to supplement them with a lightweight external monitor using catpaw plugins and FlashDuty for robust alerting.
Learn how to diagnose and resolve frequent Kubernetes pod status issues such as ContainerCreating, ErrImagePull, Pending, CrashLoopBackOff, and UnexpectedAdmissionError by examining Docker services, storage mounts, ConfigMaps, image repositories, and node resources, with practical examples and command‑line solutions.
This step‑by‑step guide shows how to install FastDFS on a Linux server, configure its tracker and storage nodes, integrate it with Nginx, and expose the file service to the Internet using the cpolar tunneling tool, all with detailed commands and configuration files.
This article explains how systematic test case creation, clear verification steps, and disciplined bug tracking improve testing efficiency, ensure comprehensive coverage of core system logic and data flows, and help teams identify root causes to continuously raise software quality despite limited resources.
This article breaks down high‑availability system design into six critical layers—architecture, development standards, application services, storage, product safeguards, and operations—offering concrete practices such as capacity planning, fault‑tolerant patterns, monitoring, and incident‑response strategies to achieve four‑nine (99.99%) uptime.
The 2023 China International Service Trade Fair’s Enterprise Digital Transformation Forum highlighted ICBC Fund’s award‑winning DevOps‑based trading management platform, showcasing how a high‑cohesion, low‑coupling architecture and dual mid‑platform foundation enable online operations, risk compliance, and industry‑first DevOps certification.
This article describes how Qunar implemented an automated root‑cause analysis system for flight‑ticket transaction interception, detailing the problem background, system research, a custom algorithm focusing on explanatory power, performance optimizations that reduced analysis time from five minutes to under ten seconds, and the resulting operational improvements.
The article explains how Home Depot (THD) adopted the VALET pattern language—Volume, Availability, Latency, Error, and Ticket—to unify service‑level objectives, automate data collection, build dashboards, and improve SRE practices across its massive retail and e‑commerce infrastructure.
This article introduces Ansible as an open‑source automation tool, explains its core architecture and workflow, and provides detailed usage of its seven primary commands with examples, helping readers quickly grasp how to configure, deploy, and manage systems efficiently.
1Panel is a modern open‑source Linux server operations management panel that can be installed on Ubuntu with a single command, after which users obtain a temporary access URL and credentials to start managing their servers through a web interface.
This article explains the essential fault metrics MTTR, MTBF, and MTTF, their definitions, calculations, and practical importance for SRE and operations teams to improve system availability, guide maintenance strategies, and make data‑driven reliability decisions.
This article provides a comprehensive overview of Apache Kafka, covering its architecture, core concepts such as topics, partitions, and replicas, common operational commands, and practical performance‑tuning tips for high‑throughput, low‑latency streaming workloads.
This article reviews eight popular Docker monitoring solutions, detailing their key features such as performance metrics, dashboards, alerting, capacity planning, log analysis, and ease of setup, helping you choose the right tool for container observability.
The article outlines how organizations over a hundred engineers must go beyond merely copying DevOps practices by adopting three progressive steps—normalization, standardization, and platformization—to achieve measurable, scalable efficiency, and concludes with a promotional notice for a Python‑based continuous deployment training course.
This article explains how intelligent supply‑chain concepts can be applied to the pharmaceutical sector by outlining the industry's supply‑chain structure, digital transformation opportunities and challenges, data‑capability monetization models, and the use of AI and knowledge‑graph technologies to capture growth opportunities.
This article describes a real‑world OceanBase failure scenario where a core dump fills the data disk, and provides a step‑by‑step guide to shrink datafiles to 80% of disk capacity, adjust parameters, reduce tenant replicas, offline and reinstall OBServer instances, and finally restart the cluster.
This article explores the four pillars of technical operations—Dao (philosophy), Fa (methodology), Shu (techniques), and Qi (tools)—detailing concepts from business continuity to SRE, FinOps, GitOps, CMDB design, and the underlying logic of modern ops platforms.
The document proposes a declarative, multi‑OS baseline management platform that groups servers, supports gray‑release rollouts, monitors state, and automatically restores configurations, extending open‑source tools to provide versioned, conditional, and auditable system‑environment control across a large‑scale infrastructure.
This article outlines the most common production failures—including network, server, database, software bugs, security vulnerabilities, storage, configuration errors, and third‑party service issues—and provides detailed steps for detection, investigation, and resolution to ensure system stability and reliability.
This article shares Huolala's experience designing a unified monitoring platform UI, covering the evolution from open‑source dashboards to a fully self‑developed solution, simplification of PromQL, computed metrics, log and trace integration, and the challenges of alert configuration and visualization.
The Network Quality Monitoring Center is a large‑scale system that deploys lightweight agents on every server to issue coordinated ICMP ping probes, a controller to generate and distribute topology‑aware PingLists, and a storage‑analysis module that aggregates latency and loss data for real‑time visualization, alerting and troubleshooting, while addressing load‑balance, ingestion concurrency, and future extensions such as UDP/TCP probes.
The article explores why building system stability is crucial by linking entropy theory to software reliability, introduces the availability formula, discusses common pitfalls and industry practices, and proposes a three‑stage governance framework—prevention, mitigation, and post‑mortem—to systematically improve operational resilience.
During system development and operations, missing exception stack traces can hinder troubleshooting; this article explains how JIT compiler optimizations like Fast Throw cause stack traces to disappear, outlines conditions for Fast Throw, shows performance impact, and demonstrates how to locate root causes using logs and metrics.
During a night‑time outage, a XCache (Codis + Pika) instance hung due to massive write load triggering low‑level protection, causing Sentinel to switch masters; the proxy’s accept queue filled with timed‑out sockets, blocking new connections, so scaling the proxy layer and expanding capacity restored service while prompting automation, health‑check, and queue‑overflow alerts.
This guide explains how Linux stores user and group information in /etc/passwd, /etc/shadow, /etc/group, and /etc/gshadow, and provides detailed usage of commands such as useradd, usermod, userdel, groupadd, groupmod, and gpasswd for creating, modifying, locking, and deleting accounts and groups.
Learn how to efficiently monitor multiple Kubernetes pods by installing and using two lightweight, real‑time log aggregation tools—Kubetail and Stern—including installation steps for Homebrew, Linux, and Zsh, command‑line options, color output, and practical usage examples.
This guide explains how to export Docker images for MySQL and Zabbix components, transfer and load them on an offline Kirin production server, and then run MySQL, Zabbix Java gateway, Zabbix server, and Zabbix web containers with the necessary configuration and linking.
This article shares practical Linux and Vsphere techniques—including using rsync for rapid bulk deletions, detecting new iSCSI disks without reboot, safeguarding rm commands, mounting remote filesystems with SSHFS, and adding users to supplementary groups via gpasswd—to streamline daily operations.
Kubernetes is moving its Debian and RPM package repositories to the community‑owned pkgs.k8s.io domain, deprecating the old apt.kubernetes.io and yum.kubernetes.io sources, and the article explains the timeline, impact on end users and distributors, and step‑by‑step migration guidance.
This article introduces the open‑source web platform Mayfly-go, explains its key features for Linux system, MySQL, PostgreSQL, Redis, and MongoDB management, provides step‑by‑step installation and configuration instructions, and demonstrates how to use its project, machine, database, and system administration capabilities.
The article explains how Google measures and improves software quality before release by separating development and operations responsibilities, using monorepo and trunk‑based development, daily release candidates, automated testing, performance benchmarks, and a comprehensive Project Health (pH) metric system that balances speed, reliability, and quality.
This article compares six open‑source log management platforms—OpenObserve, Grafana Loki, SigNoz, Graylog, Syslog‑ng, and Highlight.io—detailing their features, deployment options, advantages, and drawbacks to help you choose the most suitable solution for effective observability and system performance.
New Oriental’s recent DevOps transformation details how the company tackled siloed platforms, built a unified service‑tree‑driven infrastructure, created a real‑time data processing platform, and implemented comprehensive security measures—including red‑blue exercises, penetration testing, sensitive data monitoring, and CA/KMS—to boost efficiency and reduce costs.
The article explains how Python can be leveraged for various operations automation tasks—such as remote server management, log parsing, system monitoring, batch deployment, and backup—by showcasing practical examples and code snippets for each use case.
This article examines how Baidu's search service evolved its storage architecture—from a basic key‑value table to a hybrid HDD/Redis cache and finally to a sharded, multi‑collection design—culminating in Midgard, an intelligent storage‑layer manager that abstracts and optimizes data access for changing business needs.
This guide explains essential Kafka monitoring techniques, third‑party tools, custom scripts, key metrics, and practical strategies for high availability, fault detection, rapid recovery, and ongoing testing to keep Kafka clusters stable and performant.
This article describes how a rapidly growing e‑commerce business used RPA combined with an intelligent Q&A system to automate 24/7 customer service on Enterprise WeChat, addressing resource limits, repeated queries, and large‑scale promotion spikes while preserving merchants' existing communication habits.
This article explains how a large internal network suffered severe slowdown and packet loss due to a routing loop, how traffic analysis revealed massive UDP2425 usage consuming 99% of bandwidth, and the step‑by‑step method used to identify and eliminate the loop.
This article compiles insights from technical leaders, developers, product managers, and operations staff on building effective CMDBs, highlighting common pitfalls, essential success factors, Huawei’s experience, and practical lessons for improving data modeling, automation, and cross‑team collaboration.
This guide presents a concise reference of common Linux command‑line utilities—including uname, hostname, dmesg, stat, du, date, echo, watch, which, whereis, locate and updatedb—showing their typical options, usage examples and visual output to help users quickly retrieve system information, manage files and monitor processes.
This article explains three common software release strategies—blue‑green deployment, rolling deployment, and canary (gray) deployment—detailing their principles, advantages, potential pitfalls, and practical considerations, while also contrasting them with A/B testing and noting related operational concerns.
This guide explains how to analyze Linux load situations—whether CPU and load are both high or CPU is low while load remains high—by using commands like top, vmstat, iostat, sar, and jstack, and provides practical troubleshooting steps for common I/O‑related issues.
This guide explains why log analysis is essential for Linux system health, walks through installing Logwatch on CentOS, configuring its core settings, automating daily runs via cron, and interpreting sample output for connections, SSH activity, package installs, and disk usage.
This article details Huolala's one‑stop monitoring platform called Monitor, covering its multi‑cloud architecture, data collection pipelines, real‑time business monitoring, unified alarm handling, and future AI‑driven enhancements, while sharing concrete metrics, incident case studies, and practical implementation steps for large‑scale observability.
This guide summarizes JD.com’s extensive JDK8 garbage‑collector optimization experience, covering version requirements, how to select the right GC, core and collector‑specific parameter settings, logging configuration, and concrete methods to assess GC health for latency‑sensitive and throughput‑oriented workloads.
Facing growing microservice complexity, HuoLala designed a comprehensive fault‑drill system—covering management, tooling, and operations—to simulate failures, control blast radius, automate scenarios, and continuously improve resilience, ultimately reducing downtime and enhancing system stability across more than ten business units.
Facing unpredictable software behavior, the article explains why traditional system‑level monitoring often misses critical business issues, especially in complex pricing services, and presents a comprehensive approach that combines result (black‑box) and process (white‑box) monitoring, practical metrics, and actionable recommendations to improve observability and reduce operational risk.
The article explains what high availability really means, why it’s essential, outlines six core design principles, compares cloud and on‑premise HA, highlights common pitfalls, and provides a practical multi‑AZ architecture example to help engineers build more reliable systems.
This article explains how Ansible, a Python‑based automation tool, can be used to create, modify, and delete Unix crontab entries, covering why automation is needed, installation steps, and practical playbook examples for managing scheduled tasks across multiple hosts.
This guide introduces two lightweight Kubernetes log‑tailing tools—Kubetail and Stern—explaining their installation on various platforms, core command‑line options, and practical usage examples for aggregating and filtering pod logs in real time.
This article explores the emerging role of technical operations for developer‑focused companies, sharing practical frameworks for organizing tech communities, driving content engagement, building technical brands, and defining the core abilities of effective tech ops, all illustrated with real examples from Alibaba.
The article outlines a practical framework for business‑level monitoring in banking systems, describing three evolution stages, key metrics such as transaction success rates and volume spikes, concrete alert rules, and the technical challenges of data collection, standardization, and massive parameter management.
This article examines how 58租房 introduced the “Housekeeper Talk” video‑tour product, detailing the advantages of video viewings, the end‑to‑end workflow for creators, the UI enhancements for renters, and the measurable impact on user engagement and connection rates.
Performance testing is crucial for ensuring software reliability, and this guide outlines essential best practices—including setting clear goals, selecting appropriate tools, crafting maintainable scripts, using realistic data, running long‑duration loads, and scheduling regular tests—to help engineers achieve stable, high‑performing applications.
This article explains how the CAICT‑led DevOps Capability Maturity Model guides major Chinese telecom operators—China Mobile, China Telecom, China Unicom, ZTE, Huawei and China Tower—through 31 assessments, showcasing project‑level improvements, integration of resources, and measurable gains in delivery speed, quality and operational efficiency across the industry.
Amid a nationwide digital transformation push, leading Chinese banks adopt the CAICT‑led DevOps Capability Maturity Model, using standardized assessments to improve IT efficiency, integrate resources, and support business systems, with detailed case studies from nine city‑commercial and other financial institutions illustrating measurable gains.
The article explains how capacity management balances cost control and service quality through defined goals, three development stages, detailed resource optimization methods, stress‑testing metrics and standards, and automated scaling to achieve significant cost reductions while maintaining system stability.
By integrating Kubernetes with DevOps practices, teams can automate deployment pipelines, achieve dynamic resource allocation, centralize monitoring with tools like Prometheus and Grafana, and treat infrastructure as code, resulting in faster, higher-quality software delivery and improved collaboration between development and operations.
This article examines how major Chinese state‑owned banks adopted the CAICT‑led DevOps Capability Maturity Model, detailing assessment data, case studies of continuous delivery, security, and system‑tool standards, and the measurable improvements in efficiency, risk reduction, and business agility achieved across dozens of projects.
This article reviews how seven major Chinese joint‑stock banks adopted the CAICT DevOps Capability Maturity Model, detailing their evaluation results, project implementations, and the operational improvements achieved across continuous delivery, technical operations, security, and BizDevOps practices.
At the 2023 DOIS DevOps International Summit, China Pacific Insurance leveraged a one‑stop R&D efficiency platform to successfully achieve Level‑3 continuous delivery certification for four projects, illustrating how standardized processes, integrated toolchains, and end‑to‑end metrics can accelerate digital transformation in the insurance industry.
This guide presents a collection of advanced kubectl techniques—including printing API details, filtering and deleting pods by status, counting pods per node, analyzing pod distribution across machines, and leveraging kubectl proxy—providing practical command examples and explanations for experienced Kubernetes users.
This article reviews common deployment techniques—blue‑green, rolling, and canary (gray) releases—explaining their workflows, advantages, limitations, and best‑practice precautions to help teams choose the right strategy for reliable production updates.
This article explores how the rise of cloud‑native technologies forces traditional operations to transform into service‑oriented platforms, detailing new organizational structures, the OPaS model, onion‑layered migration, practical steps, and key lessons for successful ops modernization.
Shopify’s rapid adoption of ChatGPT‑powered assistants and the later launch of the Sidekick AI tool led to aggressive cost‑cutting, a 20% workforce reduction, deteriorating customer support, rising fraud risks, and widespread criticism from merchants and insiders.
This guide provides Bash scripts to filter process details by PID or name, retrieve comprehensive user information, and apply a series of system hardening configurations—including password policies, login restrictions, and file attribute locks—to improve Linux server security and manageability.
This article examines the challenges of traditional on‑call duty systems for operations teams, proposes an SRE‑inspired rotation model that involves developers, defines concrete KPI targets, and describes how automation and chat‑bot tools can streamline incident response and reduce internal friction.
The article recommends two essential Google SRE books for backend developers, explains what SRE is, how it differs from traditional operations, and shows how the concepts like SLI/SLO, incident postmortems, and reliability engineering can be applied to improve system availability and stability.
This article analyzes high‑profile service outages, defines the production environment and its components, categorizes five types of production changes, and presents a comprehensive change‑management framework—including organizational roles, step‑by‑step procedures, and best‑practice tips—to help teams reduce risk and maintain system stability.
This article examines the trade‑offs between running Kubernetes on bare metal versus virtual machines, covering performance differences, orchestration complexity, hardware visibility, capacity planning, network impact, and when each approach makes sense for modern cloud‑native workloads.
This article introduces common Linux command‑line tools such as top, vmstat, pidstat, iostat, sar, netstat, and tcpdump, explaining the meaning of their output fields and how to use them for diagnosing CPU, memory, disk I/O, and network performance issues on servers.
The article details the Bank of Communications' participation in the 2023 XOps Forum, its successful DevOps continuous‑delivery level‑3 assessment for two projects, the resulting efficiency gains, metrics, and future plans for expanding DevOps practices across the organization.
This article explains performance monitoring concepts, lists essential metrics such as response time and CPU utilization, introduces popular monitoring tools like Prometheus and New Relic, and outlines a step‑by‑step process for selecting, configuring, visualizing, alerting, and continuously improving system performance.
This guide explains essential Linux monitoring tools—top, vmstat, pidstat, iostat, netstat, sar, and tcpdump—detailing the metrics they expose, how to interpret CPU, memory, disk, and network statistics, and practical command examples for effective server performance troubleshooting.
The article examines recent Stack Overflow research and academic studies revealing that a large share of developers consider many meetings unnecessary, explains the clash between Maker's and Manager's schedules, and offers practical ways to reduce meeting waste and boost productivity.
This article details how a rapidly expanding B2B fresh‑food company restructured its R&D organization, adopted a matrix management model, and built a comprehensive distributed infrastructure—including task scheduling, service discovery, messaging, logging, file storage, CDN, configuration, sharding, search, caching, and monitoring—to support nationwide warehouse operations and future growth.
When a pod crashes and continuously restarts, using kubelet logs may fail to capture output, but the kubectl --previous flag lets you access the logs of the previous container instance by reading the linked log files stored under /var/log/pods.
This guide explains the three main ELK deployment architectures, compares Logstash and Filebeat collectors, introduces a cache‑queue option for high‑volume logs, and provides practical solutions for multiline log merging, timestamp correction, and module‑level filtering in Kibana, helping operations teams build efficient log pipelines.
This article explains why website performance directly impacts business goals, outlines a four‑scenario testing framework (baseline, capacity, stability, and exception), and provides practical steps for environment setup, data preparation, parameterization, and execution using JMeter.
This article explains how HuoLaLa’s stability team tackled the challenge of proving their work’s value by designing and implementing a comprehensive stability metric system from scratch, detailing the motivations, principles, step‑by‑step construction, data platform, cultural adoption, measurable results, and future plans.
In this detailed case study, HuoLala's stability leader shares how a two‑year, zero‑to‑one stability metric framework was designed, implemented, and iterated—covering the why, the pain points, the metric definition process, data collection platform, cultural adoption, and the resulting 78% fault reduction and SLA improvement from three to four nines.
This article introduces a variety of Linux command‑line tools used for stress testing and performance monitoring, covering CPU, memory, disk, network, processes, load, temperature and other utilities with brief usage examples and practical tips.
This article describes Qunar's comprehensive root cause analysis platform, detailing its background, data-driven fault categorization, architecture—including trace, runtime, middleware, and event analysis modules—and demonstrates its high accuracy and practical impact on reducing incident resolution times across microservice services.
This guide explains how to set up a gray‑release (canary) deployment using Nginx as a reverse‑proxy gateway, Docker containers for isolation, and two versions of a NestJS service, with traffic split controlled by cookies and configurable percentages.
This article explores common pain points in test development, demonstrates how Shell scripting can automate repetitive Linux tasks, introduces basic commands like copy and concatenate, and presents real‑world case studies such as auto‑comment generation, memory‑usage monitoring, service management, and function encapsulation to boost productivity.
The article introduces common release techniques—blue‑green, rolling, and canary (gray) deployments—explaining their principles, advantages, drawbacks, and practical considerations, and distinguishes them from A/B testing in modern software delivery pipelines.
This guide walks through essential Redis operations, covering real‑time monitoring with the INFO command and Prometheus‑compatible exporters, data migration using Redis‑shake, consistency verification via Redis‑full‑check, and comprehensive cluster management with CacheCloud, providing practical tools for reliable Redis administration.
This article examines the shortcomings of traditional host‑based deployments, explains the GitOps methodology with declarative configuration and automation tools, and details a real‑world implementation at NetEase Cloud Music using Horizon CD, Argo CD, and Helm to achieve scalable, reliable, and version‑controlled cloud‑native releases.
