This article explains the concept of Prometheus exporters, details the four metric types, provides step‑by‑step Go code for creating custom exporters and collectors, and outlines best practices for designing robust, production‑ready monitoring exporters.
This tutorial walks through setting up a DTLE 3.21.07.0 monitoring environment by configuring DTLE and Nomad metrics, deploying Prometheus and Grafana via Docker, and creating common monitoring panels such as CPU, memory, bandwidth, latency, and TPS using PromQL.
This article explains how to use Redis INFO commands to track memory usage, command processing, latency, key eviction and fragmentation, and provides practical tips such as adjusting maxmemory, using hash structures, pipelines, and slowlog to diagnose and improve Redis performance.
The article introduces Hulk, a Go service development framework created by the short‑video R&D team to replace PHP monoliths, outlines its background, design principles, component hierarchy, comparison with GDP2, and demonstrates how its built‑in monitoring, configuration, and tooling improve code quality, development speed, and SRE efficiency across Baidu’s short‑video services.
This article explains Prometheus' custom Rule system, detailing the structure and components of alerting rules, the rule manager's loading and updating process, group scheduling, evaluation cycles, and the logic for generating, updating, and sending alerts, enabling advanced monitoring extensions.
This article explains how Prometheus evolved from a Google internal project to a CNCF‑graduated, top‑ranked time‑series database and full‑stack monitoring ecosystem, detailing its history, core features, architecture, and the roles of its components such as Exporters, Pushgateway, Service Discovery, and Alertmanager.
This guide provides a comprehensive walkthrough of Prometheus fundamentals, component architecture, deployment patterns, node‑exporter setup, Grafana integration, kube‑state‑metrics, and detailed Alertmanager configuration for Kubernetes monitoring.
This tutorial demonstrates how to add Actuator dependencies to a Spring Boot 1.5.7 application, expose Prometheus‑compatible metrics, collect them with a Dockerized Prometheus instance, and visualize the data using Grafana, including all required configuration files and code snippets.
This guide presents practical best‑practice configurations for Elasticsearch clusters in production, covering JVM heap sizing, CPU thread‑pool tuning, optimal shard counts, replica strategies, hot‑warm node architecture, node role settings, common troubleshooting tips, cache handling, refresh intervals, and essential monitoring APIs.
The design separates the original I/O pool into dedicated network, I/O, and polling thread pools, adds comprehensive monitoring of task duration and frequency, enforces unified polling rules, and automatically tunes pool parameters, resulting in a 76 % reduction in UI lag and easier troubleshooting.
Hulk is a Go‑based web service framework created by the short‑video R&D team to replace a PHP monolith, extending the unreleased GDP2 platform with business‑specific wrappers, a four‑layer architecture, and integrated monitoring, tracing, and deployment tools that dramatically boost development speed, runtime performance, and SRE efficiency for high‑traffic short‑video services.
This article introduces Grafana v8.1’s Geomap panel, detailing its multiple base‑layer options, enhanced custom markers, heatmap layer, flexible data‑layer mappings, and a new sharing feature that lets several map panels synchronize on a single dashboard.
The article presents a domain‑specific language that mimics Excel formulas, a stack‑based parser and recursive engine for evaluating calculations, and a multi‑layer architecture—including a dynamic priority scheduler—to efficiently resolve field dependencies, improve maintainability, and enable monitoring across large data systems.
This guide outlines practical steps for maintaining Kubernetes nodes, configuring pods, standardizing logging, and implementing effective monitoring and alerting to ensure stable, secure, and observable workloads in production environments.
This article explains why observability is essential for DevOps, outlines four key practices—including production‑environment monitoring, structured logging, a DevOps‑focused culture, and pre‑deployment observability with remote debugging—to help teams detect, diagnose, and prevent issues throughout the software lifecycle.
The Sysdig 2021 report analyzes container usage across thousands of customers, highlighting the most popular open‑source services, the rise of Go and Prometheus, container density and image size trends, alert strategies, and detailed Kubernetes adoption patterns in cloud‑native environments.
This guide explains how to plan, configure, and execute full‑link performance testing—including network architecture, testing objectives, environment isolation, platform setup, various load‑generation methods, monitoring, and post‑test analysis—to ensure reliable, scalable services under heavy traffic.
Volcengine’s Data Quality Platform bridges the gap between data validation and resource‑intensive computation in large‑scale environments, offering unified stream‑batch monitoring, data exploration, comparison, and alerting across Hive, ClickHouse, Kafka, and more, while addressing scalability, latency, and resource optimization challenges.
This tutorial explains how to set up a real‑time ELK log analysis platform, covering the architecture of Elasticsearch, Logstash and Kibana, detailed installation commands, configuration for Spring Boot and Nginx logs, and how to run the stack continuously with Supervisor.
This article outlines a comprehensive approach for technology leaders to create a fast‑responding, high‑efficiency engineering team by integrating business, technology, monitoring, operations, and management practices, detailing goals, frameworks, and measurable outcomes.
This guide explains how to allocate CPU and memory to containers and pods in Kubernetes, clarifies resource units, demonstrates practical Deployment, ResourceQuota, and LimitRange configurations with YAML examples, and lists useful tools for monitoring and enforcing resource constraints.
Learn how to configure and use the open‑source time‑series database InfluxDB in a Spring Boot application, covering essential concepts, dependency setup, property configuration, scheduled data writing, and verification via InfluxDB CLI, with complete code examples.
This article explains how Xianyu identifies, monitors, and resolves Android ANR issues by analyzing root causes, implementing SIGQUIT‑based detection, inspecting thread stacks, and applying concrete optimizations such as SharedPreferences replacement, network broadcast caching, and delayed component registration, ultimately cutting ANR rates by more than half.
This article introduces a curated list of open‑source MySQL operational tools—including online DDL changers, backup and restore utilities, load‑testing frameworks, flashback solutions, slow‑query analyzers, replication consistency checkers, audit platforms, and graphical clients—explaining their principles, usage scenarios, and visual references.
This guide walks beginners through understanding logs, using them for error tracing, applying monitoring and alerts, and performing remote debugging to quickly pinpoint and resolve production problems, emphasizing practical steps and best practices for reliable system maintenance.
This article introduces a curated list of popular open‑source projects for SRE and DevOps, covering monitoring, deployment, chaos engineering, and reliability tools such as Cloudprober, Istio, Checkov, Litmus, Locust, Prometheus, and more, highlighting their key features and practical use cases.
This article outlines a complete backend technology stack for startups, covering language choices, core components, processes, systemization, and detailed selections for project management, DNS, load balancing, CDN, RPC frameworks, service discovery, databases, messaging, logging, monitoring, configuration, deployment, and operational best practices.
This guide outlines a comprehensive backend technology stack for startups, covering language choices, core components, development processes, infrastructure services, database options, monitoring, CI/CD, and operational best practices to help teams design, select, and implement a reliable server-side architecture.
This article examines frequent HBase RegionServer failures caused by long GC pauses, oversized scans, and HDFS decommissioning, outlines step‑by‑step troubleshooting procedures—including log searches, GC tuning, scan size limits, and monitoring strategies—and provides practical solutions to prevent and resolve these issues.
In this talk, Gal Bashan explains how serverless architectures complicate observability and why metrics, logs, and especially distributed tracing with tools like OpenTelemetry, Jaeger, or commercial platforms are essential for gaining end-to-end visibility, automating instrumentation, and maintaining reliable, business-focused services across cloud providers.
Learn to quickly pinpoint Linux server bottlenecks by running ten powerful commands—uptime, dmesg, vmstat, mpstat, pidstat, iostat, free, sar, and top—within a minute, interpreting their outputs using the USE method to assess utilization, saturation, and errors across CPU, memory, disk, and network resources.
This article outlines the design and implementation of a high‑performance, reactive API gateway built on RxNetty, detailing its overall architecture, request routing, conditional routing, API management, rate‑limiting, circuit breaking, security policies, monitoring, tracing, and future enhancements within a microservices ecosystem.
This article explains the overall architecture of a reactive API gateway built on RxNetty, detailing its request dispatch, conditional routing for gray releases, API management, rate‑limiting and circuit‑breaking, security policies, and integrated monitoring and tracing within a microservices ecosystem.
This article examines the challenges faced by a search middle platform—such as inaccurate impact assessment, unstable underlying clusters, and missing process standards—and details a comprehensive quality‑assurance strategy that includes baseline test suites, stability practices, performance testing, emergency drills, and systematic monitoring to ensure reliable search services.
This article explores the challenges of log aggregation in micro‑service architectures, introduces a globally unique log identifier (logid) with its required properties, compares various logid generation schemes, and presents end‑to‑end solutions for log distribution, aggregation, and analysis using custom tools such as ylog and watcher.
This article presents a practical, out‑of‑the‑box ELK‑based solution for private deployments, detailing design principles, rapid one‑click setup with Jenkins, component choices, log and metric collection using Beats, alerting with ElastAlert, and automated Kibana dashboard configuration.
This article describes Baidu's comprehensive approach to monitoring game microservices, covering the background, initial monitoring tools, evolution of the monitoring system, systematic design for risk control, intelligent detection, alarm optimization, efficient fault localization, and future outlook for high‑availability architecture.
This article details Baidu's comprehensive microservice monitoring practice for its game platform, covering the initial fragmented setup, systematic redesign across risk control, intelligent monitoring, smart alerting, and rapid fault localization, and presents the resulting monitoring architecture, visualizations, and future improvement goals.
This guide walks you through installing and configuring the ELK stack—Elasticsearch, Logstash, and Kibana—on Ubuntu, setting up Logstash shipper and indexer pipelines, integrating Spring Boot and Nginx logs, and managing the services with Supervisor for reliable, real‑time log analysis.
This article provides a thorough walkthrough of Spring Boot Actuator's native endpoints, explaining their purpose, configuration, and usage with practical code examples and screenshots, enabling developers to monitor, diagnose, and manage Spring Boot microservices effectively.
This article explains how to use chaos engineering with Gremlin to design, execute, and analyze four experiments that test Kafka broker load, message loss, split‑brain scenarios, and ZooKeeper outages, helping improve the reliability and resilience of Kafka deployments.
This guide walks through adding Spring Boot Actuator to a project, configuring default and custom endpoints, securing shutdown operations, and demonstrates practical code snippets and curl commands for monitoring and managing a Spring Boot application.
This article outlines how to design, print, collect, and manage online service logs efficiently—covering log levels, key information, formatting, rolling, local vs. remote storage, real‑time collection, and tool selection—to turn logs into a valuable debugging and analytics asset.
The article describes Xianyu’s local services architecture, tackling rapid supplier onboarding, heterogeneous quality, and stability by reusing core platform capabilities, defining merchant, audit, and independent business domains, employing high‑concurrency rate limiting, idempotent retries, unified exception handling, status‑change logging, and proactive monitoring with alerts and reporting.
This article provides a comprehensive overview of Redis monitoring metrics—including performance, memory, basic activity, persistence, and error indicators—along with recommended monitoring tools, configuration settings, and command-line examples for gathering and interpreting these metrics in production environments.
Learn ten practical strategies—from safe change rollbacks and cautious destructive commands to robust backups, clear prompts, vigilant monitoring, and disciplined handovers—that help DBAs and operations engineers avoid costly system failures and maintain reliable production environments.
This article provides a comprehensive guide on integrating the Alibaba Druid JDBC connection pool into a Spring Boot application, covering its components, powerful monitoring features, password encryption, SQL parsing, Maven and YAML configuration, filter setup, and how to access the Druid monitoring console.
This guide walks you through configuring Flink metrics, installing and linking Pushgateway, Node_exporter, Prometheus, and Grafana, and finally visualizing and alerting on Flink metrics, providing a complete end‑to‑end monitoring solution for Flink clusters.
This article walks through Flink's metric system by explaining the core interfaces such as MetricReporter and MetricRegistry, showing how metrics are added, registered, and queried during TaskManager startup, and detailing both REST and Prometheus approaches for retrieving metric values.
This article outlines essential Kubernetes operational practices—including node maintenance, kernel upgrades, Docker and kubelet tuning, pod resource limits, scheduling strategies, health probes, logging standards, and monitoring setups—to ensure applications run reliably, securely, and efficiently in production environments.
This article explores the fundamental concepts of software architecture, illustrates scaling challenges with examples like Uber and Weibo, and details multi‑tier designs, caching strategies, service decomposition, monitoring, and operational practices for building and maintaining high‑performance, billion‑user backend systems.
This presentation by NetEase senior SRE Jin Chuan details the current state of NetEase's big data platform, introduces the internally built EasyOps management system, explains a generic Ansible‑based operation framework, describes Prometheus/Grafana monitoring and alerting, and shares practical lessons on network, storage, and cloud migration for large‑scale Hadoop services.
This guide compiles a comprehensive set of Linux commands and Java diagnostic utilities—including tail, grep, awk, find, tsar, btrace, Greys, Arthas, and JProfiler—offering practical examples and code snippets to help developers quickly identify and resolve performance and stability issues in production environments.
This guide explains how Zabbix 4.4+ lets you use custom JavaScript in webhook media types to send alert notifications, details the built‑in Zabbix objects, shows configuration steps, data validation, logging rules, and provides a complete DingTalk webhook script with testing instructions.
Netflix’s in‑house Telltale system consolidates diverse monitoring data, reduces alert noise, provides multidimensional health assessments, and delivers intelligent, context‑rich notifications, enabling engineers to quickly diagnose and resolve issues across more than 100 production services.
The article details Netflix’s internally built Telltale monitoring platform, explaining its motivation, key features such as multi‑dimensional health assessment, smart alerting, event management, deployment monitoring, and continuous optimization, and how it improves operational efficiency for over a hundred production services.
Spring Boot Actuator provides extensive monitoring and management features via HTTP and JMX; this guide shows how to enable it, lists each endpoint such as /auditevents, /beans, /caches, /conditions, /env, /health, and demonstrates configuration, custom endpoints, and code examples for full utilization.
This comprehensive guide walks you through Prometheus' origins, core features, installation methods, configuration files, PromQL basics, exporter setup, Grafana integration, alerting with Alertmanager, and advanced topics like service discovery, providing a complete roadmap for building a production‑grade monitoring system.
This guide walks through setting up Prometheus and Grafana to monitor a Spring Boot 2.3.11 application, covering environment preparation, Maven dependencies, Spring configuration, custom metrics, Prometheus server setup, and visualizing data in Grafana.
Grafana 8.0 introduces a major overhaul of its alerting system, new visualizations such as state timeline, history and histogram panels, reusable library panels, fine‑grained access control, real‑time streaming, enhanced Loki log navigation, and expanded tracing support, all aimed at faster, more flexible observability.
This article shares Haro's practical experience in designing and operating a distributed message governance platform that unifies RocketMQ, Kafka, and other middleware, covering metrics, monitoring, alerting, scenario‑based controls, and high‑availability strategies to keep microservices reliable under sudden traffic spikes.
This article explores the fundamentals of IT monitoring, examines common challenges such as scalability, reliability, and alert fatigue, compares four implementation approaches—from open‑source to fully custom solutions—and presents practical techniques like alert convergence, suppression, and automation to build a robust, adaptable monitoring platform.
This article presents seven practical Bash scripts that help Linux administrators quickly gather system status, back up MySQL databases, monitor services, scan network hosts, manage user passwords, and verify MySQL replication, each accompanied by clear code examples and usage instructions.
The article recounts a weekend on‑call incident where a Java monitoring service suffered network packet loss and a severe memory leak, leading to massive timeouts, high CPU usage, and frequent GC, and explains how the problem was diagnosed and resolved using tools such as top, jstat, jstack, jmap, and MAT.
The article details the design, architecture, and operational challenges of the Beidou frontend monitoring platform at 58 Group, covering SDK management, behavior trace logging, front‑back link integration, performance optimizations, minute‑level alerting, and permission management.
This article explores the fundamental concepts of system architecture, scaling challenges, multi‑level caching, service decomposition, and monitoring techniques in massive web platforms, using Weibo’s evolution from LAMP to service‑oriented architecture as a detailed example.
This guide explains how to configure comprehensive JVM garbage-collection logging—including basic GC details, object age distribution, heap snapshots, pause times, safepoint statistics, and reference processing—while using timestamped filenames and JVM log rotation to avoid overwriting and manage file size effectively.
This article explains how to monitor MySQL full-text indexes by describing relevant InnoDB parameters, the metadata tables that expose index activity, and step‑by‑step examples that create a sample table, configure monitoring, observe cache behavior, and manage index maintenance operations.
Lin Ying, a senior test manager at Guoxin Securities, shares insights from his GOPS 2021 talk on the securities industry's digital transformation, current IT challenges, and a comprehensive red‑blue exercise strategy that combines full‑link load testing, automated workflows, and proactive monitoring to ensure system stability during market peaks.
This article details a four‑stage migration project that rebuilt international services on a cloud‑native stack, introducing temporary Istio monitoring, standardized change processes, Helm‑based deployments, and full microservice integration while sharing practical quality‑assurance lessons and pitfalls.
This article explains the architecture of a complete event‑tracking system, introduces two kinds of front‑end events, and details the technical design and implementation of the monitor‑tracer SDK for page visibility/active time as well as the monitor SDK for custom trigger events, including lifecycle monitoring, DOM observation, decorators, and React hooks.
The article analyzes WeChat's success by detailing its three‑pronged strategy of precise product timing, agile project management, and robust technical support, and explains how the team applies agile attitudes, modular design, extensible protocols, disaster‑recovery mechanisms, and fine‑grained monitoring to operate a massive, highly available system.
This article presents JD Daojia's practice of containerizing MySQL, detailing the underlying resource platform, custom container scheduling algorithm, high‑availability design, monitoring system, and an automated operations platform that together improve performance, cut costs, and boost operational efficiency.
This article analyzes the stability challenges of a multi‑store chain’s product‑copy mechanism, outlines design goals for isolation and scalability, and presents short‑ and long‑term monitoring, flow‑control, and emergency‑response strategies to ensure reliable large‑scale operations.
This tutorial explains how to use Zabbix Agent 2 to monitor MongoDB databases and clusters, covering the required read‑only user setup, relevant Zabbix templates, key metrics such as jumbo chunks, connection pool stats, server status, collection and replSet information, and practical configuration examples.
The presentation details NetEase's big data platform operations, covering current usage, the internally built EasyOps control system, a generic service‑operation framework based on Ansible, Prometheus‑Grafana monitoring, configuration management, network and storage optimizations, and lessons learned from cloud migration.
This article details Ximalaya's evolution of its HTTP gateway—from a Tomcat NIO prototype to a fully asynchronous Netty design—covering architectural diagrams, performance bottlenecks, traffic management features, monitoring, GC tuning, and future plans for HTTP/2 and graceful degradation.
The JD Health Technical Product Team organized a comprehensive 618 promotion preparation in 2021, covering system architecture reviews, capacity assessments, performance stress testing, offensive‑defensive drills, system optimization, 24‑hour monitoring, and product operation training to ensure high availability and stable service during the large‑scale sales event.
This guide presents a detailed MySQL inspection checklist covering operating‑system metrics, critical MySQL parameters, status queries, replication health, high‑availability components, and useful SQL scripts, enabling DBAs to efficiently monitor performance, detect issues, and maintain reliable database services.
Gaode Ride‑Hailing created a comprehensive 360° observability platform—standardized logging, distributed tracing, multi‑domain metrics, visual dashboards, and an incident workflow—that transforms raw data into actionable insights, accelerates root‑cause analysis, and enables automated fault defense for its large‑scale cloud‑native microservice system.
This article outlines the challenges of operating petabyte‑scale big‑data clusters and presents a comprehensive monitoring framework—including basic and upgraded monitoring layers, metric collection, alerting pipelines, and strategies for alarm convergence and grading—to ensure reliable, proactive SRE operations.
A sysadmin narrates how he monitors four Redis nodes, detects master failure with PING, promotes a slave using SLAVEOF, reconfigures the remaining replicas, and ultimately automates the entire process with a custom Sentinel program and a multi‑node Sentinel cluster for high availability.
This article details Liulishuo's customized Prometheus monitoring architecture, including data backup to Aliyun SLS, ECS service discovery, advanced alerting with PagerDuty and Goalert, GitOps-driven config management, cloud resource exporters, SLA monitoring, and future plans for storage and alert pipelines.
This article provides a comprehensive overview of microservices, explaining their definition, core characteristics, advantages and drawbacks, suitable organizational contexts, and the essential technical components such as service discovery, API gateways, configuration centers, communication protocols, monitoring, circuit breaking, and container orchestration platforms.
The article provides a comprehensive English overview of SkyWalking UI, detailing its dashboard metrics, topology visualization, trace analysis, performance profiling workflow, and alarm management, illustrating how the tool monitors microservice and cloud‑native environments with metrics such as throughput, latency, Apdex, and JVM statistics.
This guide explains why monitoring is essential throughout a product lifecycle, outlines monitoring modes and methods, compares health checks, logs, tracing and metric solutions, and provides a detailed Prometheus‑based monitoring architecture with concrete metric definitions, alerting rules, and incident‑response procedures.
This article describes how a Chinese securities firm applied big‑data‑driven clustering and Bayesian methods to automate root‑cause analysis of trading‑system anomalies, detailing the challenges, algorithmic designs, practical implementations, and evaluation results that demonstrate significant reductions in false alarms and faster recovery.
This article introduces ten popular open‑source projects for monitoring, deployment, and reliability engineering, detailing each tool's purpose, key features, and how they help Site Reliability Engineers build scalable, highly reliable cloud‑native systems.
To prevent page failures and white‑screen errors, the team built a front‑end SDK that fetches fallback data from OSS + CDN, offers configurable black/white‑list rules, lightweight validation, and a visual backend, cutting error rates from over 8% to 0.55% and dramatically improving interface stability.
This article explains high availability fundamentals, defines availability, outlines design targets, presents common metrics such as MTBF, MTTR, MTTF, SA, RPO, RTO, discusses CAP theory, essential design elements, and answers practical Q&A on cost, architecture, fault tolerance, testing, and implementation guidance.
This article explains the fundamental differences between traditional and cloud‑native monitoring systems, outlines the challenges each faces, and details JD.com's evolution from physical servers to JDOS 2.0, describing its modular architecture, deployment model, and ongoing optimization efforts.
Facing rising traffic, JD Daojia’s in‑house load‑testing platform was redesigned to automate script management, enable distributed JMeter execution, integrate real‑time monitoring, and support custom RPC protocols, dramatically lowering manual effort, cutting test cycles from an hour to fifteen minutes while ensuring system stability.
An operations engineer narrates how he monitors a four‑node Redis cluster, detects master failure with continuous PINGs, promotes a slave to master, reconfigures replicas, and automates the entire process with a sentinel program and a sentinel cluster for high availability.
This article examines the business context and collection workflow of a BOS‑integrated service, dissects the distributed lock logic and its execution sequence, and conducts a thorough structured code review that reveals logical, exception, non‑functional, and testability issues while offering concrete improvement recommendations.
This article outlines essential Kubernetes best‑practice guidelines for production environments, covering health probes, resource allocation, RBAC, cluster configuration, networking policies, monitoring, logging, stateless design, autoscaling, runtime security, and strategies for zero‑downtime and failure recovery.
This article surveys the most popular open‑source projects for Site Reliability Engineering and DevOps, covering monitoring, deployment, chaos testing, and observability tools such as Cloudprober, Istio, Prometheus, Litmus, and more, highlighting their key features and how they help build scalable, high‑reliability cloud‑native systems.
This article provides a complete tutorial on Prometheus, covering its origins, core features, installation methods (binary and Docker), configuration file structure, PromQL basics, HTTP API usage, Grafana integration, various exporters for metrics collection, and alerting with Alertmanager, all within a cloud‑native monitoring context.
This article introduces essential Linux monitoring utilities—including top, vmstat, pidstat, iostat, netstat, sar, and tcpdump—explaining their output fields, typical usage scenarios, and how to interpret CPU, memory, disk, and network performance metrics for effective system troubleshooting and optimization.
ByteDance’s cloud‑native migration of stateful services uses a custom SolarService extending StatefulSet with Budset CRD to handle versioned data, shard‑aware routing, NUMA‑aware scheduling, advanced storage, eBPF monitoring, and automated PDB eviction, delivering efficiency, cost savings, and reliable rolling upgrades.
This article explains how Alibaba's KubeProbe system combines black‑box probing and directed inspections to detect issues in massive ASI Kubernetes clusters before users notice them, detailing the architecture, implementation, integration with release pipelines, and real‑world results that improve reliability and operational efficiency.
