Tagged articles
log monitoring
74 articles · Page 1 of 1
This chapter expands monitoring beyond server resources to business results, covering server, business, log monitoring, active reporting, and passive scanning to detect silent failures, and outlines a seven-step design process with alert deduplication, escalation, and reconciliation scans.
Observabilityactive reportingalert fatigue
0 likes · 9 min read

This article walks through a practical AIOps solution that replaces brittle keyword rules for Easysearch Elasticsearch clusters with a three‑step pipeline—Filebeat log ingestion, Flask‑driven LLM analysis, and automated email alerts plus ES feedback—detailing configuration, code, pitfalls, and suitability.
AIOpsDeepSeekElasticsearch
0 likes · 12 min read

This article provides a concise, step‑by‑step guide to the fifteen most frequently used Nginx commands, showing how to check versions, start, stop, reload, test configurations, view logs, monitor connections and ports, and troubleshoot common errors on Linux systems.
ConfigurationLinuxNginx
0 likes · 6 min read

This guide walks through designing and implementing an intelligent operations workflow that transforms passive log monitoring into proactive alerting and automated remediation, covering core concepts, tech‑stack selection, step‑by‑step configuration of log collection, alert rules, webhook integration, Ansible automation, and best‑practice considerations for scaling and security.
AIOpsAnsibleGrafana
0 likes · 7 min read

This guide walks you through the most critical Linux security flaws—from privilege‑escalation and misconfigured sudo to SSH, web server, kernel, and container risks—offering concrete hardening steps, logging practices, firewall rules, incident‑response procedures, and compliance tips to build a resilient production environment.
Linux-securitySSH hardeningcontainer security
0 likes · 16 min read

Learn how to install Kibana, connect it to Elasticsearch, explore data with Discover, craft queries using Lucene syntax, create visualizations and dashboards, and monitor your stack, all with detailed step‑by‑step instructions and screenshots to help you master this powerful analytics platform.
ElasticsearchKibanaLucene Query
0 likes · 14 min read

This guide explains how to install and use the kubectl tail plugin—a krew‑based tool that streams logs from multiple Kubernetes Pods and containers in real time, covering prerequisites, offline manifest download, installation steps, and practical command examples for various selectors.
Kuberneteskrewkubectl
0 likes · 6 min read

This guide explains how to transform Elasticsearch from a simple log repository into an intelligent operations AI assistant that provides real‑time monitoring, natural‑language query, automated troubleshooting, security threat detection, and low‑code interaction, covering architecture, deployment steps, sample queries, visualization, and resource cleanup.
AI operationsElasticsearchNatural Language Query
0 likes · 7 min read

This guide walks you through the fundamentals of the ELK stack—Elasticsearch, Logstash, and Kibana—explaining its architecture, installation on Ubuntu, configuration of Logstash shipper and indexer roles, integration with Spring Boot and Nginx logs, and how to run the components as background services using Supervisor.
ElasticsearchKibanaLogstash
0 likes · 20 min read

This guide shows how to collect Nginx access logs, convert them to JSON, store them in Loki, and create real‑time dashboards in Grafana, covering installation, configuration, Docker deployment, and required plugins for a complete monitoring solution.
GrafanaLokiPromtail
0 likes · 8 min read

Monitoring key Linux log files—such as syslog, auth.log, kern.log, and others—is crucial for system health, security, and troubleshooting, and this guide explains the purpose of each log, practical commands for viewing them, and automation techniques using scripts, cron, and tools like journalctl and Sematext.
LinuxSecuritybash
0 likes · 20 min read

LoggiFly is a lightweight Docker log monitoring tool that detects predefined keywords or regex patterns, supports multi‑channel notifications, can automatically restart or stop containers, and offers flexible deployment via environment variables or YAML configuration, helping ops teams maintain stable containerized environments.
DockerLoggiFlycontainer
0 likes · 6 min read

This article walks through configuring Infini Gateway to capture and log Elasticsearch request traffic, setting up index templates and ILM policies, importing a Kibana dashboard, and visualizing key metrics such as request latency and success rates for real‑time monitoring and performance optimization.
ElasticsearchINFINI GatewayIndex Lifecycle Management
0 likes · 9 min read

This guide explains how to view and follow Linux log files in real time using tail (including -f, -F, and -n options), multitail for multiple logs, lnav as an alternative viewer, and less with Shift+F, plus installation commands for each tool.
LinuxReal-timeless
0 likes · 5 min read

This tutorial walks through setting up the lightweight Loki log aggregation system together with Grafana using Docker Compose, integrating Loki into a SpringBoot application via the loki‑logback‑appender, and configuring Grafana dashboards to visualize distributed logs on a low‑memory server.
DockerGrafanaLoki
0 likes · 7 min read

This article chronicles the author’s progression from a novice to a proficient log analyst in game development, explaining what logs are, how to collect and classify them, establishing standards and workflows, and detailing the implementation of log monitoring and QA processes for reliable game operations.
QAgame developmentgame logging
0 likes · 20 min read

This article explains why monitoring abnormal code branches is crucial, outlines the challenges of log analysis, proposes a log‑clustering engine with spell and DBSCAN algorithms, describes its architecture, workflow, and implementation details, and highlights the benefits for system stability and operational efficiency.
Algorithmlog clusteringlog monitoring
0 likes · 15 min read

This article introduces Baidu's log platform that handles billions of daily events, explains UBC logging concepts and monitoring requirements, and details a low‑cost, high‑accuracy architecture using real‑time streaming, dimension mapping, watermarking, and time‑window aggregation to achieve reliable, scalable event monitoring.
UBCWatermarkbig data
0 likes · 14 min read

This article explains Baidu's log‑center architecture for handling billions of UBC events per day, detailing UBC concepts, monitoring requirements, a low‑cost scalable design with dimension mapping, watermarking, data trimming and time‑window aggregation, and the resulting performance and cost benefits.
Cost OptimizationUBCWatermark
0 likes · 13 min read

Baidu’s log platform processes billions of daily page‑view events and, to monitor them accurately with minute‑level latency, implements a downstream streaming‑task architecture that maps limited custom dimensions, uses watermarks for completeness, trims raw data, aggregates into 5‑minute windows, and outputs concise metrics to Elasticsearch, achieving high accuracy, configurability, and low cost.
UBCWatermarkdimension mapping
0 likes · 11 min read

This article explains Baidu's log platform architecture, the UBC event‑tracking protocol, monitoring requirements, and the low‑cost, high‑accuracy solutions—including dimension mapping, watermark handling, data trimming, and time‑window aggregation—that enable real‑time, customizable monitoring of petabyte‑scale log streams.
Cost OptimizationUBCWatermark
0 likes · 13 min read

This guide shows how to collect Nginx access logs, convert them to JSON, ship them with Promtail to Loki, and display the data in Grafana dashboards, including setup steps, configuration snippets, and troubleshooting tips for a lightweight observability stack.
DockerGrafanaLoki
0 likes · 9 min read

This article presents a Python‑based solution that queries LogEasy data, calculates key metrics such as total requests, 5xx errors, average response time, and unique visitors, formats the results into Excel and HTML reports, and automatically sends them via email and DingTalk alerts for operational monitoring.
DingTalkemail automationlog monitoring
0 likes · 30 min read

This guide walks through installing Nginx, configuring Promtail and Loki to collect JSON‑formatted access logs, adding GeoIP support, deploying Grafana via Docker, connecting the Loki data source, and creating a dashboard with the world‑map panel to visualize website traffic.
GeoIPGrafanaJSON Logs
0 likes · 8 min read

Learn how to efficiently monitor multiple Kubernetes pods by installing and using two lightweight, real‑time log aggregation tools—Kubetail and Stern—including installation steps for Homebrew, Linux, and Zsh, command‑line options, color output, and practical usage examples.
Cloud NativeKuberneteskubetail
0 likes · 12 min read

This guide explains how to collect Nginx access logs, convert them to JSON, ship them with Promtail to Loki, and visualize the data in Grafana, including installation steps, configuration snippets, GeoIP setup, and dashboard customization for a complete observability solution.
GrafanaLokiNginx
0 likes · 9 min read

The article shares practical experiences and techniques for game testing automation, covering fake player usage, script modularization, report generation, IDE template utilization, custom log tools, and developer habits to improve efficiency and code quality across testing workflows.
Automation TestingCoding PracticesIDE
0 likes · 18 min read

The article details NetEase Cloud Music’s Corona monitoring pipeline, explaining how SDKs report logs via an HTTP service, how a transmission layer normalizes and stores them, how a Flume‑like collector forwards logs to HBase and Kafka, and how Flink tasks shard and filter streams for various monitoring services while handling traffic spikes and offering an independent Node.js channel for other business units.
Distributed SystemsFlinkKafka
0 likes · 10 min read

Learn how to efficiently monitor Kubernetes workloads by deploying log agents and using two powerful real‑time log aggregation tools—Kubetail and Stern—including installation steps, usage examples, and detailed command‑line options for filtering, coloring, and exporting logs across multiple pods and containers.
CLI toolsCloud NativeKubernetes
0 likes · 12 min read

This guide details how to configure Alibaba Cloud Log Service alarms—setting one‑day tokens, handling 1024‑byte truncation, removing record limits with analysis statements, adding a 10‑second query offset for timeliness—and shows how to visualize the data in Grafana using SQL queries for multi‑line and pie charts with timestamp conversion and time‑series filling.
Cloud LoggingGrafanaSQL
0 likes · 6 min read


21CTONov 9, 2022 · Operations
This article details Ctrip’s large‑scale log monitoring architecture, covering the overall Overview, the Clog log system, the CAT tracing platform, and the internal TSDB solution, explaining how billions of logs are processed in real time with low latency, high reliability, and efficient querying.
Distributed SystemsTracingbig data
0 likes · 12 min read

This article details Ctrip's large‑scale, real‑time log monitoring solution, covering the overall monitoring architecture, the Clog log system, the CAT tracing platform, and the TSDB metric store, and explains design choices such as write‑heavy indexing, segment‑based storage, and migration to ClickHouse for high‑cardinality data.
Distributed Systemsindexinglog monitoring
0 likes · 11 min read

This article explains how to identify and mitigate malicious bot traffic by analyzing web server logs, using command‑line queries, specialized log‑analysis tools, centralized platforms, and automated security workflows, while also outlining operational metrics and response processes for effective protection.
WAFbot detectionlog monitoring
0 likes · 32 min read

The article presents the Yunji logging system, a Flink+ClickHouse-based cloud-native platform for real-time ingestion, storage, querying, analysis, and monitoring of massive heterogeneous logs, covering its architecture, configuration center, storage design, processing flow, monitoring features, and future enhancements.
ClickHouseCloud NativeFlink
0 likes · 21 min read

This guide walks through setting up an ELK stack to collect, parse, and visualize Nginx access logs, covering Logstash configuration, Grok patterns, Elasticsearch setup, Nginx proxy with basic authentication, and creating Kibana dashboards for log analysis.
ElasticsearchKibanaLogstash
0 likes · 12 min read

Learn how to instantly watch and follow log files on Linux using tools like tail, tailf, tail -F, multitail, lnav, and less, with installation tips, command options, and practical examples for both single and multiple log streams.
Linuxlesslnav
0 likes · 6 min read

This guide explains how to integrate ELK's Logstash with Zabbix using the logstash‑output‑zabbix plugin, covering installation, configuration of Logstash pipelines, Zabbix template and trigger setup, and testing the end‑to‑end alerting workflow.
Logstashalertingelk
0 likes · 17 min read

This article explains how to design and implement a terabyte‑level log monitoring platform using ELK Stack, FileBeat, Elastic APM, Kafka Streams, Prometheus, and Grafana, covering data collection, filtering, visualization, and resource‑efficient processing for large‑scale microservice environments.
GrafanaKafka StreamsLogging
0 likes · 9 min read

This article explains how game QA teams can systematically investigate player‑reported damage and attribute anomalies by understanding combat value structures, implementing attribute and skill‑settlement logging, and applying automated analysis to identify and resolve bugs that affect gameplay balance.
QAattribute analysiscombat system
0 likes · 13 min read

This article explains how to build a terabyte‑level log monitoring platform for micro‑service environments by unifying log collection with FileBeat, enriching observability through Elastic APM, processing streams via Kafka Streams, and visualizing metrics with Grafana and Kibana, while addressing cost‑effective filtering and retention strategies.
ELK stackGrafanaKafka Streams
0 likes · 8 min read

This guide explains how to use Linux commands such as tail, tail‑f, tail ‑F, multitail, lnav and less to monitor log files in real time, covering installation, usage examples, and options for handling rotated logs and selective line output.
LinuxReal-timeless
0 likes · 6 min read

This article explains how to design and implement a TB‑scale log monitoring solution using the ELK stack, FileBeat, Elastic APM, Kafka Streams, Prometheus and Grafana, detailing architecture, data collection, filtering, visualization, and the trade‑offs of resource usage in large‑scale microservice environments.
ELK stackGrafanaKafka Streams
0 likes · 8 min read

This guide explains how to monitor Linux log files in real time using commands such as tail (with -f, -F, and -n options), tailf, multitail, lnav, and less, including installation steps and example usages for Apache logs.
Linuxlesslnav
0 likes · 5 min read

Discover ten easy‑to‑use web log security analysis tools that help you trace attackers, identify vulnerabilities, and visualize malicious activity, ranging from open‑source visualizers to enterprise‑grade SIEM platforms.
SIEMSecurity toolsinformation security
0 likes · 4 min read

This article explains how to design and implement a TB‑level log monitoring system for microservice environments using the ELK stack, detailing log collection with FileBeat, tracing via Elastic APM, resource‑efficient processing with Kafka Streams, and visualization through Grafana and Kibana.
GrafanaKafka Streamselastic apm
0 likes · 8 min read

This article explains how to design and implement a centralized log monitoring platform using the ELK stack, Filebeat, Elastic APM, Prometheus, and Kafka Streams to collect, filter, visualize, and alert on petabyte‑level logs across thousands of microservices.
GrafanaKafkaPrometheus
0 likes · 9 min read

This article explains how to design and implement a TB‑level log monitoring platform for micro‑service environments using ELK Stack, Filebeat, Elastic APM, Kafka Streams, Prometheus, and Grafana, covering data collection, filtering, storage, and visualization while addressing cost and resource constraints.
GrafanaKafka Streamselastic apm
0 likes · 9 min read

This tutorial explains how to set up an open‑source ELK (Elasticsearch, Logstash, Kibana) stack for real‑time log collection, parsing, and visualization, covering component installation, Shipper/Indexer configuration, Grok pattern creation, Nginx integration, and background service management with Supervisor.
ElasticsearchKibanaLogstash
0 likes · 19 min read

The Mobile SkyNet platform adds a dedicated mobile monitoring layer to SaaS services, using Zanlogger for error, warning, and info logs, Kafka‑HBase pipelines for high‑throughput storage, WeChat‑based alerting, and an MPaaS console for issue visualization, reducing mobile‑side incidents by about twenty percent.
Backend IntegrationData StorageWeChat integration
0 likes · 11 min read

This guide provides a comprehensive walkthrough of Kibana, covering installation, connection to Elasticsearch, data discovery, query syntax, visualizations, dashboards, and monitoring, with step‑by‑step instructions and screenshots to help users effectively explore and visualize their Elasticsearch data.
DashboardElasticsearchKibana
0 likes · 12 min read

In large‑scale microservice environments, centralized log collection, filtering, and visualization using Filebeat, Elastic APM, Kafka Streams, Grafana and Prometheus can turn scattered logs into actionable operational data while controlling resource costs.
GrafanaKafka StreamsMicroservices
0 likes · 9 min read

To address the challenges of managing logs across hundreds of microservices in production, the article presents an enterprise log monitoring solution that centralizes collection via Filebeat, processes logs with Kafka Streams, visualizes data using Grafana and Kibana, and integrates Elastic APM for tracing and performance metrics.
KafkaMicroserviceselk
0 likes · 8 min read

The article describes an enterprise‑grade log monitoring solution that unifies log collection, filtering, cleaning, and visualization across hundreds of microservices using tools such as Filebeat, Elastic APM, Kafka Streams, Prometheus, Grafana and Kibana to improve troubleshooting, performance analysis, and operational efficiency.
GrafanaKafka Streamselastic apm
0 likes · 8 min read

This article explains the three main performance‑monitoring approaches—log‑based, agent‑based, and network‑traffic analysis—detailing their data‑collection methods, comparing deployment time, data completeness, impact, risk and scalability, and illustrating their differences with a real‑world failure case.
GartnerPerformance Monitoringagent monitoring
0 likes · 10 min read

This guide walks you through installing the Mailx email client on a Linux server, applying necessary patches, configuring SMTP settings, testing email delivery, and creating a shell script that monitors log files for keywords and automatically sends alert emails when matches are detected.
Linuxemail alertslog monitoring
0 likes · 4 min read


ITPUBMar 19, 2020 · Operations
This guide walks you through installing Mailx on a Linux server, fixing compilation issues, configuring SMTP settings, testing email delivery, and building a keyword‑based log‑monitoring script that triggers alerts via email.
Linuxemail alertslog monitoring
0 likes · 4 min read

This guide walks through installing the Mailx email client on a Linux server, applying a patch to fix compilation errors, configuring SMTP settings, testing email delivery, and building a shell script that monitors log files for keyword anomalies and triggers email alerts.
email alertslog monitoringmailx
0 likes · 5 min read


ITPUBMar 5, 2020 · Operations
This guide explains how to use Linux command‑line tools such as tail, tailf, tail ‑F, multitail, lnav, and less to continuously watch log files, covering installation, key options, and practical examples for single‑ and multi‑file monitoring.
Linuxcommand-lineless
0 likes · 5 min read

Learn how to monitor Linux log files in real time using essential command‑line tools such as tail (with -f, -F, and -n options), multitail, lnav, and less, including installation commands and practical examples for single and multiple log streams.
Linuxlesslnav
0 likes · 5 min read

This guide walks through setting up ELK to collect, parse, and visualize Nginx access logs, covering Logstash configuration, Grok patterns, GeoIP enrichment, Elasticsearch indexing, and Nginx proxy with basic authentication, enabling real-time log analysis and dashboard creation.
ElasticsearchKibanaLogstash
0 likes · 13 min read

This guide explains how to use Linux commands such as tail, tailf, tail -F, multitail, lnav, and less to monitor log files in real time, covering installation, key options, and practical examples for single and multiple log streams.
lesslnavlog monitoring
0 likes · 5 min read

This guide explains how to install ngxtop on CentOS 7, outlines its key features for real‑time Nginx log analysis, and demonstrates common commands for monitoring request counts, top client IPs, filtering 404 responses, and analyzing access logs both live and offline.
Nginxlog monitoringngxtop
0 likes · 4 min read

This guide explains how to combine Tencent Cloud Elasticsearch with the Elastic Stack—Filebeat, Logstash, and Kibana—to automatically collect JSON‑formatted logs from development workflows, route them to dynamically created indices, and visualize status dashboards, while highlighting best‑practice tips for schema design, deduplication, and future scaling.
BeatsElastic StackElasticsearch
0 likes · 6 min read


ITPUBAug 3, 2018 · Operations
When high service reliability demands immediate detection of slow requests, this guide shows three Python techniques—using tail via subprocess, file.tell/seek loops, and a generator with yield—to continuously watch log files and trigger alerts as soon as specified patterns appear.
PythonReal-timefile handling
0 likes · 4 min read

This article explains how the ELK stack (Elasticsearch, Logstash, Kibana) and Heka can be quickly integrated into mobile games to collect, store, analyze, and alert on log data, improving operational efficiency, troubleshooting speed, and overall service reliability.
AIOpsElasticsearchHeka
0 likes · 7 min read

This article explains how Tencent's ZhiYun full‑link log monitoring platform handles massive daily logs, overcomes challenges of diverse log formats, high throughput, fault‑tolerant design, and provides scalable storage, query, and alerting capabilities for distributed micro‑service environments.
Distributed SystemsFault Tolerancebig data
0 likes · 10 min read

This article details the end‑to‑end process of designing and deploying an operations‑focused monitoring framework, covering semantic, log, and performance monitoring, protobuf integration, implementation challenges, actual effects, and future optimization directions for large‑scale online services.
Performance MonitoringProtobufad-hoc queries
0 likes · 13 min read

This guide explains how to configure Zabbix log monitoring using log and logtr keys, details each parameter, describes the monitoring mechanics, and shows how to set up items and view results, enabling reliable detection of specific log patterns.
Configurationlog monitoringoperations
0 likes · 7 min read

This article explains various enterprise log types, recommends monitoring tools like Cacti, Zabbix, Splunk, and the ELK stack, and details architectures for handling server, application, and user‑click logs using technologies such as Logstash, Elasticsearch, Kibana, Kafka, Flume, and Spark.
AnalyticsKafkaSpark
0 likes · 26 min read

This article explains how Wonder's log monitoring system works, covering rolling count, string and numeric matching types, the underlying Go implementation with tail reading, alert strategies, and future enhancements for handling large log files.
alertinggolanglog monitoring
0 likes · 7 min read

This guide walks through setting up ElastAlert—a Python‑based alerting framework for Elasticsearch—by covering the required environment, dependencies, installation steps, index creation, configuration files, rule testing, and execution on an Ubuntu system.
ElastAlertElasticsearchPython2
0 likes · 5 min read

This article shares the author's experience and lessons learned while building a log‑monitoring framework with the ELK stack, discussing performance issues, configuration of Logstash filters using Grok, and practical tips for deploying ElasticSearch, Logstash, and Kibana in production environments.
ElasticsearchKibanaLogstash
0 likes · 8 min read

This article explains how to use the Linux tail command to monitor log files in real time, filter errors, and reliably continue following logs after rotation by using the -F option, providing practical guidance for system administrators and developers.
LinuxLog Rotationlog monitoring
0 likes · 2 min read

This guide explains why log analysis is critical, outlines common challenges, compares heavyweight trace systems with the lightweight LEK stack, and provides step‑by‑step installation, configuration, and best‑practice tips for Logstash, Elasticsearch, and Kibana.
ElasticsearchKibanaLogstash
0 likes · 12 min read
