The article recounts Firefly Thinking's early BI system limitations, the decision‑making process that led to adopting Volcano Engine, subsequent operational strategies to unlock tool potential, and a forward‑looking vision of data analysis in the large‑model era.
This article introduces a ready‑to‑use Linux batch‑operation script that enables non‑expert administrators to update, configure, and manage multiple Ubuntu 22.04 servers simultaneously—covering functions such as updating the script, creating SSL certificates, generating SSH keys, bulk password changes, and deploying or removing ALEO services—while also offering a free, comprehensive Linux command and shell‑script tutorial.
This article shares practical Prometheus best‑practice tips—from understanding its accuracy‑reliability trade‑offs and self‑monitoring, to avoiding NFS storage, managing high‑cardinality metrics, handling rate() and recording‑rule pitfalls, and fine‑tuning alerting—so you can run a stable, low‑cost monitoring stack.
This article examines how quality assurance engineers can adopt observability principles—distinct from conventional monitoring—to enhance system health detection, root‑cause analysis, and proactive risk mitigation across resources, services, business functions, data, and logs.
The article recaps the two‑day 24th GOPS Global Operations Conference in Shanghai, highlighting opening remarks, major speaker sessions on DevOps, BizDevOps, AIOps, large‑model applications, industry case studies, and provides links to presentation materials.
China Southern Airlines achieved leading BizDevOps and continuous delivery capabilities by passing both international ITU DevOps and domestic standards across three key projects, highlighting the strategic impact of DevOps standardization on business value, technology integration, and digital transformation within the airline industry.
This article details China’s 2024‑2027 ITU‑DevOps standard action plan, CAICT’s dual international and domestic DevOps assessments, Changan Auto’s successful Gaia platform certification, and insights from senior executives on implementation challenges, benefits, and future DevOps trends.
FAW‑Volkswagen’s R&D Efficiency Platform and Integrated Operations Platform passed both ITU DevOps international and domestic standards, showcasing a comprehensive case study of digital transformation, platform engineering, and standards‑driven DevOps adoption in the automotive industry.
This article presents a comprehensive list of 17 in‑depth DevOps interview questions asked by a Swedish company, covering Linux boot processes, Kubernetes internals, Git workflows, Jenkins pipelines, networking, monitoring, databases, Docker, and soft‑skill topics to help candidates prepare effectively.
This article presents a detailed overview of change management practices, covering compatibility design across hardware, base software, and applications, release strategies, gray‑deployment techniques, data migration analysis, rollback planning, configuration change control, and verification procedures to ensure system stability and reliability.
This guide outlines comprehensive change‑management practices—including compatibility design across hardware, base and application software, structured release planning, gray‑release techniques, data‑migration safeguards, rollback mechanisms, and configuration control—to ensure system stability and reliability during updates.
A detailed post‑mortem of a Redis outage shows how a traffic surge filled bandwidth, caused massive input and output buffers to consume almost all memory, and led to timeouts, while offering step‑by‑step analysis, memory diagnostics, and practical recommendations to prevent similar buffer‑overflow failures.
This guide explains what a program and a process are, describes process creation, lifecycle, and identifiers, and provides detailed usage of essential Linux commands such as ps, top, pgrep, pstree, lsof, vmstat, iostat, iftop, dstat, as well as foreground/background control and scheduling with at and crontab.
This article walks operations engineers through the concepts, components, and detailed installation steps for setting up a Zabbix distributed monitoring system on Linux, including server and agent configuration, web front‑end deployment, custom items, triggers, and email alerts.
This article explains why disk space may not be freed after deleting large log files on a Linux server, describes the underlying file system mechanisms, and provides a step‑by‑step troubleshooting guide using /tmp cleanup and the lsof command to identify and kill lingering processes.
Effective operations management acknowledges inevitable downtime, emphasizes automation, prioritizes proactive prevention, treats technology as a means rather than an end, integrates closely with development through DevOps, relies on strong communication, and continuously addresses pervasive security challenges to minimize business impact.
This document outlines the terminology, background, requirements, task classifications, state model, and detailed architecture—including TaskScheduler, TaskWorker, and TaskConsole components—of a new distributed task scheduling system designed to replace Celery in a database automation platform, with emphasis on scalability, reliability, and extensibility.
This article compiles real-world anecdotes from Zhihu users describing computers and servers that have run continuously for years or even decades, highlighting examples such as a 14‑year Red Hat Linux machine, a 20‑year base‑station, long‑standing DOS and Sun systems, and space probes that have operated for nearly half a century.
This article introduces ten essential tools for operations engineers—Shell scripts, Git, Ansible, Prometheus, Grafana, Docker, Kubernetes, Nginx, ELK Stack, and Zabbix—detailing each tool's functionality, typical scenarios, advantages, and real‑world examples with code snippets for practical automation and monitoring.
This guide explains how to design and implement Prometheus metrics for application monitoring, covering the selection of monitoring targets, the four golden metrics, system‑specific metric groups, vector and label choices, naming conventions, histogram bucket design, and useful Grafana visualization tips.
This guide explains how to use Nginx's HttpLogModule to configure access_log and log_format directives, customize log parameters, enable log caching, and set per‑location logs with buffer and flush options for efficient troubleshooting and performance monitoring.
This article explains Netflix's chaos engineering practice, detailing the challenges of microservice reliability, the implementation of the Chaos Monkey tool, the step‑by‑step methodology, guiding principles, and real‑world outcomes that demonstrate improved system availability.
A comprehensive guide lists ten indispensable tools for operations engineers, detailing each tool's functionality, ideal use cases, advantages, and real‑world examples, plus practical code snippets for automation, monitoring, container orchestration, and log analysis.
This guide outlines ten practical strategies—including rollback testing, safe handling of destructive commands, prompt customization, robust backup and verification, production environment discipline, thorough handover, proactive monitoring, cautious auto‑failover, meticulous execution, and simplicity—to help operations engineers dramatically reduce system outages and improve reliability.
The article explains the role of a chief DevOps engineer, outlining core duties such as infrastructure design, automation, and cultural leadership, the essential technical and soft‑skill requirements, and the advantages this position brings to an organization’s efficiency, reliability, and collaboration.
The article describes how an automated resource‑balancing system continuously monitors Redis host memory usage, selects optimal nodes, safely migrates them through a multi‑step process (adding slaves, verifying replication, promoting masters, deleting old nodes), and provides task management and notification features to maintain high availability and reduce manual DBA effort.
This guide presents a comprehensive collection of automation operation scripts—including baseline health checks, business inspections, organized directory structures, naming conventions, and download links—designed to streamline system, network, database, and cloud infrastructure management.
This guide outlines the ten core tool categories—from Linux basics and networking services to scripting, firewalls, monitoring, clustering, and backup—that a Linux operations engineer should master to become an effective sysadmin.
After a nationwide outage of Docker image registries since June 6, recent ping tests show that get.docker.com and download.docker.com are now reachable in China, offering developers restored access without VPNs, though the article also includes a promotional Python course invitation.
This article explores the DevOps mindset, its core principles such as collaboration, automation, continuous improvement, and customer focus, outlines essential practices like CI/CD, IaC, monitoring, microservices, and provides a step‑by‑step adoption roadmap illustrated with a detailed case study and future trends.
The article outlines the key competencies a DevOps engineer must master—including programming, Linux system knowledge, configuration management, infrastructure-as-code, CI/CD tools, networking and security, monitoring, and cloud services—to guide readers on building a comprehensive skill set for effective DevOps practice.
The article recounts the Shanghai Stock Exchange’s sudden P0 outage that halted trading, analyzes the causes such as massive order volume and system bottlenecks, and discusses how distributed architectures and message‑queue based queuing can mitigate similar high‑concurrency failures.
This article examines the characteristics of ZhaiZhai's B2B auction scenario, defines core pricing metrics, presents a step‑by‑step methodology for determining optimal starting prices, reviews early practices and their shortcomings, and details the current modular machine‑learning model architecture that improves transaction rates and reduces price premiums for second‑hand smartphones.
This guide compiles 50 practical troubleshooting and remediation techniques covering system, network, application, database, and security layers, enabling operations engineers to quickly diagnose failures, apply targeted fixes, and maintain stable, secure infrastructure.
When a Linux server shows performance issues, the first minute is critical; this guide walks you through ten standard command‑line tools—uptime, dmesg, vmstat, mpstat, pidstat, iostat, free, sar, and top—explaining what each metric means and how to interpret the output for quick troubleshooting.
This article provides a comprehensive overview of Nginx's high‑performance architecture, including its core, basic, and third‑party modules, master‑worker process model, asynchronous non‑blocking I/O mechanisms, FastCGI and PHP‑FPM integration, and practical configuration and tuning tips for optimal server operation.
This article compares chaos engineering and fault testing, outlines fault injection techniques, implementation layers, testing strategies, challenges, and future trends such as automation, AI-driven diagnostics, and cloud‑native integration, providing a comprehensive guide for improving system resilience and reliability.
This guide demonstrates how to set up a two‑node Keepalived configuration in dual‑host mode, creating two VRRP instances that act as master and backup to enable seamless VIP address migration between the servers.
This article presents ten indispensable tools for operations engineers—detailing each tool’s functionality, ideal use cases, advantages, and real‑world examples, from shell scripting and Git to Ansible, Prometheus, Grafana, Docker, Kubernetes, Nginx, the ELK stack, and Zabbix, helping professionals streamline automation, monitoring, and deployment tasks.
A lithium‑battery fire at Alibaba Cloud's Singapore C zone data centre on September 10 triggered a multi‑day outage that crippled major cloud products, affected dozens of tech companies, and highlighted the challenges of extinguishing battery fires in critical infrastructure.
This article examines the key pain points of massive AI compute clusters—including heterogeneous hardware compatibility, efficient scheduling, training and inference acceleration, and fault‑tolerant operations—while presenting practical management and performance‑tuning strategies, a cloud‑native AI platform implementation, and future directions for the ecosystem.
This guide compiles the most frequently used Linux commands—covering help utilities, file and directory manipulation, content processing, compression, system information, networking, disk management, permissions, user administration, and process control—to provide a comprehensive reference for effective system operation and troubleshooting.
While AI can automate many routine DevOps tasks such as scripting, CI/CD pipeline creation, and infrastructure design, it cannot replace the contextual understanding, critical thinking, experience, and judgment of senior DevOps engineers, who will evolve into architects and innovators rather than being rendered obsolete.
Pinterest’s performance program details how the team defines custom Pinner Wait Time metrics, uses real‑user monitoring and fine‑grained alerts to detect regressions quickly, and follows structured root‑cause analysis and ownership processes to prevent performance degradation across web surfaces.
The article explains that technology‑driven firms, financial institutions, large multinational corporations, and innovative startups are the main types of companies that tend to offer high salaries to operations engineers because of their critical reliance on stable and secure IT infrastructure.
This article chronicles the author’s progression from a novice to a proficient log analyst in game development, explaining what logs are, how to collect and classify them, establishing standards and workflows, and detailing the implementation of log monitoring and QA processes for reliable game operations.
This article walks you through a systematic approach to identify the root cause of a Linux server's CPU hitting 100%, from pinpointing the high‑load process with top, tracing the responsible business code, to using a custom shell script that streamlines thread analysis and resolves the overload.
The article shares a software engineer’s personal journey, emphasizing the importance of solid fundamentals, proactive output, curiosity‑driven problem solving, documentation, and process optimization to build lasting technical competence and reduce tacit knowledge throughout a career.
The article details China’s 2024‑2027 Information Standardization Action Plan, the CAICT’s DevOps assessment framework, and showcases how automotive firms like FAW‑Volkswagen and Chang'an have achieved top‑tier continuous delivery and system‑tool standards, highlighting key metrics and the role of international ITU standards.
This article details ByteDance’s disaster‑recovery evolution—from a single‑room deployment to same‑city multi‑data‑center setups and finally to active‑active multi‑region architectures—explaining the challenges, specific failure scenarios, and the strategic practices used to ensure continuous service during outages.
This guide explains practical commands like du, find, and lsof to locate large directories or deleted files consuming disk space, and shows how to adjust reserved filesystem space with tune2fs to reclaim lost capacity.
This article explains the MBTI framework, outlines its four dimensions, and matches each of the 16 personality types to specific operations (运维) positions, highlighting the strengths and ideal job responsibilities for each type.
This article walks through a complete, step‑by‑step solution for collecting Nginx access logs, converting them to JSON, shipping them with Promtail to Loki, and visualizing the data in Grafana, including Docker deployment, dashboard import, and world‑map plugin installation.
This guide outlines comprehensive best practices for database server operations, covering hardware selection, OS and kernel tuning, storage choices, MySQL configuration, performance monitoring, backup strategies, security measures, high availability, automation, and systematic maintenance procedures to ensure optimal reliability and efficiency.
This article explains the concept of observability, contrasts it with traditional monitoring, outlines its benefits for system stability, reliability and performance, and provides practical guidance on building a full‑stack observability platform using logs, metrics, tracing and modern cloud‑native tools.
This guide walks you through creating a cloud‑based service that bundles Black Myth: Wukong, the Steam client, and a remote desktop tool, detailing instance setup, remote configuration, streaming steps, and troubleshooting to achieve a seamless gaming experience.
This article outlines the background, overall framework, and platform construction of enterprise digital transformation, illustrating each component with detailed diagrams that guide organizations in planning and implementing comprehensive digital strategies to achieve competitive advantage.
This article shares ten practical operations strategies—including change rollbacks, safe handling of destructive commands, prompt customization, rigorous backup and verification, production environment discipline, careful handovers, robust alerting, cautious automatic failover, meticulous checks, and simplicity—to dramatically improve system reliability and availability.
This article explains why service stability is critical, outlines the importance and key factors of synthetic monitoring, provides practical guidelines for implementing it, and then describes fault‑drill concepts, benefits, processes, and common cloud‑native tools to proactively discover and mitigate failures in micro‑service environments.
Learn how to set up Nginx as a front‑end load balancer for web applications, define upstream servers and proxy_pass directives, and apply round‑robin, least‑connected, ip‑hash, weight, timeout, and backup server options to optimize traffic distribution and reliability.
On August 19, NetEase Cloud Music suffered a severe infrastructure‑related outage that prevented user login, playlist loading, and song search, prompting a two‑hour recovery effort, a brief free‑membership compensation, and highlighting the critical role of proper change management, gray releases, disaster recovery, and cross‑functional coordination in large‑scale services.
This article outlines a typical operations incident workflow, identifies four key stages where large language models can assist, discusses implementation challenges, introduces the Ops framework and Copilot design, and shares practical examples and a real‑world case to help engineers adopt AI‑driven fault management.
This article analyzes real‑world search query characteristics, breaks down a typical search system architecture, classifies cacheable data, compares result‑level, intermediate‑value and multi‑layer caches, discusses update, prefetch and placement strategies, and highlights common pitfalls such as cache miss, consistency, and resource overhead.
This article explains what a data metric system is, why it’s essential for organizations, the stages of building it, required resources, organizational alignment, and a step‑by‑step path to create a robust, data‑driven indicator framework that supports product development, operations, and strategic decision‑making.
On August 19 the NetEase Cloud Music service suffered a major outage that was traced to a complex migration of its Hangzhou data center to Guizhou, highlighting large‑scale operational risks, technical debt, and strict continuity constraints for high‑traffic internet platforms.
This article examines the pain points of a custom ticket system, introduces FastGPT’s knowledge‑base and query capabilities, outlines integration architecture and concrete features, and shows how the combined solution reduces ticket resolution time dramatically while improving overall operational efficiency.
The author recounts a sudden CPU spike on a Kubernetes pod caused by excessive JVM garbage collection, walks through step‑by‑step diagnostics using top, thread inspection, jstack, and network file transfer, identifies a flawed Excel export loop, and shares the fix and lessons learned.
A detailed account of GitHub’s recent worldwide outage reveals that a rollback of database infrastructure changes caused widespread service failures across GitHub.com, Pages, Copilot, and the API, highlighting the challenges of stateful database reliability in large platforms.
This article outlines a comprehensive set of automated operations scripts, including baseline checks, service monitoring, Docker and Kubernetes maintenance, security inspections, and a well‑organized directory layout with roles, system, network, database, application, security, automation, and infrastructure sections.
This article describes how to use Grafana's Flowcharting plugin and Prometheus metrics to create a dynamic, interactive dashboard that visualizes each logical node of a push notification pipeline, enabling rapid trace‑ID based troubleshooting and reducing manual investigation effort.
This guide explains how to identify and remove outdated Elasticsearch indices by listing shards, filtering target indices, deleting them with a shell loop, and automating the process with a scheduled cron job, helping keep ELK performance optimal.
A collection of Zhihu answers debates whether adopting Kubernetes is necessary, presenting viewpoints from developers and ops leaders, highlighting cost, complexity, operational benefits, deployment commands, and practical considerations for small and large scale projects.
This guide outlines key operational metrics—availability, failure rate, MTTR, MTBF, response time, throughput, error rate, capacity utilization, latency, data integrity, and more—explaining their calculations, typical benchmark values, and practical application areas to help organizations monitor and improve IT performance.
This article introduces ten indispensable tools for operations engineers, detailing each tool's functionality, ideal use cases, key advantages, and practical examples, while also providing code snippets and visual illustrations to help readers understand and apply them effectively.
The article details China's 2024‑2027 IT standards action plan, CAICT's dual ITU and domestic DevOps assessment, Changan Automobile's Gaia platform passing both certifications, and insights from senior engineers on the benefits, implementation challenges, and future roadmap of their DevOps transformation.
The article analyzes why test environments are inherently less stable than production, identifies frequent changes as the root cause, and proposes two container‑based approaches—One‑Box for small services and soft isolation for large microservice systems—plus automated health and business inspections to achieve reasonable, cost‑effective stability.
This technical report details the background, architecture, construction, core issues, migration plans, and future roadmap of moving 58's HBase clusters to a cloud‑native environment, highlighting cost reduction, operational automation, and performance optimizations.
This article outlines the three essential steps for scaling a tag system from initial deployment to full maturity, highlights typical challenges such as incomplete functionality, business system integration, and permission management, and provides practical solutions and best‑practice recommendations for each stage.
This article compiles several Zhihu users' candid accounts of a typical Linux operations day, highlighting constant interruptions, emergency firefighting, performance tuning, monitoring, tool development, and a balanced time‑allocation strategy to make ops work more efficient and sustainable.
This article explains the concept of quality operations, outlines its main components, lists essential quality‑operation KPIs, describes how to collect and analyze KPI data, and shows how to align KPI metrics with overall business strategy.
FAW‑Volkswagen successfully earned both ITU DevOps international certification and the domestic DevOps standard assessment for its R&D Efficiency Platform and Integrated Operations Platform, showcasing how standardized DevOps practices can accelerate digital transformation, improve delivery quality, and enhance operational efficiency in the automotive industry.
The article details the design, core technical solutions, high‑availability architecture, performance optimizations, and open capabilities of Buffalo, JD.com’s distributed DAG‑based job scheduling platform that supports massive task volumes, complex dependencies, and flexible resource management.
This article analyzes the role, application scenarios, stability challenges, and comprehensive governance framework of Apache Kafka at Soul, covering deployment, configuration, monitoring, standard controls, common misuse, and future directions toward cloud‑native solutions.
This article introduces Ansible as an open‑source automation tool, explains its declarative, abstract and idempotent characteristics, shows how to install it with pip, outlines its core architecture components, describes its working principles, and provides usage examples for its seven main commands.
This guide explains the key Docker CLI commands—including image listing, pulling, saving, loading, removing, running, starting, stopping, and inspecting containers—providing clear examples and output to help you efficiently manage Docker images and containers.
This comprehensive guide outlines the seven key pillars—operations, high‑availability architecture, capacity governance, change management, risk governance, fault management, and chaos engineering—that together form a systematic approach to building and maintaining a reliable, 24‑hour backend system.
A sudden worldwide surge of Windows Blue Screen of Death incidents on July 1, linked to a CrowdStrike security‑agent update, crippled Microsoft 365 services, disrupted airlines and highlighted the far‑reaching impact of a single software change on global IT stability.
This article examines the characteristics of mobile application development for supply‑chain logistics, covering terminal framework selection, operations‑backend design, backend service architecture, scenario‑driven advantages, user‑experience pitfalls, and future trends such as 5G, IoT, and generative AI.
This article presents a comprehensive case study of NetEase Cloud Music's automatic upgrade platform, detailing the background challenges, technical architecture, sidecar versus component upgrades, workflow orchestration, operational safeguards, performance metrics, and future roadmap for large‑scale microservice migrations.
The article explains the core concept of deployment pipelines in Continuous Delivery 2.0, outlines essential quality‑gate mechanisms, and details five design principles—build once, loose coupling, parallelization, fast feedback, and important feedback—plus team collaboration disciplines such as immediate pause and security audit.
Jpom is a lightweight, low‑intrusion Java‑based tool that streamlines online building, automatic deployment, daily operations, and project monitoring, offering features like node management, SSH terminal, Docker handling, and easy installation, making it suitable for individuals and small enterprises.
This article provides a detailed overview of the end‑to‑end IT project management lifecycle, including product and requirement management, development and testing steps, version release procedures, and post‑release operations, offering practical guidance for teams to design and control their workflows.
Jpom is a simple, low‑intrusion Java‑based platform that provides online project building, automatic deployment, daily operations, and monitoring features, offering node management, SSH terminal, Docker handling, and a one‑click installation process suitable for individuals and small enterprises.
The article explains how to build reliable microservices by isolating failures, applying graceful degradation, change‑management, health checks, self‑healing, fallback caching, retry strategies, rate limiting, fast‑fail principles, circuit breakers, and failure‑testing to ensure high availability in distributed cloud‑native systems.
When a VMware VM with a 200 GB system disk runs an 11 GB Docker service, it may report ‘no space left on device’ because the LVM logical volume for /var is only 1 GB, and the guide shows how to extend the relevant LVM volumes and resize the filesystems to resolve the issue.
This guide outlines the purpose, scope, principles, and detailed specifications for log management—including file naming, retention periods, content rules, security handling, and monitoring—to ensure reliable issue tracing, data safety, and regulatory compliance across all system development projects.
This article walks through a real‑world incident where a data‑platform server showed near‑100% CPU usage, explains step‑by‑step investigation using top, pwdx, and jstack, identifies a time‑conversion utility as the root cause, and presents a streamlined script‑based solution that reduced CPU load by thirtyfold.
Suzhou Bank’s Mobile Banking 5.0 platform, showcased at the 23rd GOPS Global Operations Conference, demonstrates how a unified micro‑service architecture, advanced security technologies, and a comprehensive DevOps platform can elevate development efficiency, meet international standards, and drive innovative financial services.
The article explains the complete shutdown of CentOS, outlines viable alternative Linux distributions, and provides detailed guidance on planning and executing database migrations to ensure security, performance, and compatibility during the transition.
This article presents ten useful Python automation scripts covering file renaming, web page downloading, data cleaning, scheduled tasks, email sending, testing, database backup, log analysis, file compression, and document generation, each with clear explanations and ready‑to‑run code examples.
