Tag

log monitoring

0 views collected around this technical thread.

Cognitive Technology Team
Cognitive Technology Team
May 13, 2025 · Operations

Essential Linux Log Files to Monitor and How to Access Them

Monitoring key Linux log files—such as syslog, auth.log, kern.log, and others—is crucial for system health, security, and troubleshooting, and this guide explains the purpose of each log, practical commands for viewing them, and automation techniques using scripts, cron, and tools like journalctl and Sematext.

LinuxSystem Administrationbash
0 likes · 20 min read
Essential Linux Log Files to Monitor and How to Access Them
Efficient Ops
Efficient Ops
Apr 14, 2025 · Operations

How LoggiFly Simplifies Docker Log Monitoring and Automated Alerts

LoggiFly is a lightweight Docker log monitoring tool that detects predefined keywords or regex patterns, supports multi‑channel notifications, can automatically restart or stop containers, and offers flexible deployment via environment variables or YAML configuration, helping ops teams maintain stable containerized environments.

DockerLoggiFlyOps
0 likes · 6 min read
How LoggiFly Simplifies Docker Log Monitoring and Automated Alerts
NetEase LeiHuo Testing Center
NetEase LeiHuo Testing Center
Sep 6, 2024 · Operations

From Log Beginner to Pro: A QA’s Journey in Game Log Management and Monitoring

This article chronicles the author’s progression from a novice to a proficient log analyst in game development, explaining what logs are, how to collect and classify them, establishing standards and workflows, and detailing the implementation of log monitoring and QA processes for reliable game operations.

Game developmentQAgame logging
0 likes · 20 min read
From Log Beginner to Pro: A QA’s Journey in Game Log Management and Monitoring
Top Architect
Top Architect
Aug 10, 2024 · Big Data

Design and Implementation of a Scalable Real-Time Log Monitoring Platform at Baidu

This article introduces Baidu's log platform that handles billions of daily events, explains UBC logging concepts and monitoring requirements, and details a low‑cost, high‑accuracy architecture using real‑time streaming, dimension mapping, watermarking, and time‑window aggregation to achieve reliable, scalable event monitoring.

Big DataReal-time StreamingUBC
0 likes · 14 min read
Design and Implementation of a Scalable Real-Time Log Monitoring Platform at Baidu
Baidu Tech Salon
Baidu Tech Salon
Jun 18, 2024 · Big Data

Scalable, High‑Accuracy Event Logging Monitoring for Baidu's Log Platform

Baidu’s log platform processes billions of daily page‑view events and, to monitor them accurately with minute‑level latency, implements a downstream streaming‑task architecture that maps limited custom dimensions, uses watermarks for completeness, trims raw data, aggregates into 5‑minute windows, and outputs concise metrics to Elasticsearch, achieving high accuracy, configurability, and low cost.

Big DataUBCWatermark
0 likes · 11 min read
Scalable, High‑Accuracy Event Logging Monitoring for Baidu's Log Platform
Python Programming Learning Circle
Python Programming Learning Circle
Jan 27, 2024 · Operations

Automating Log Monitoring, Email Reporting, and DingTalk Alerts with Python

This article presents a Python‑based solution that queries LogEasy data, calculates key metrics such as total requests, 5xx errors, average response time, and unique visitors, formats the results into Excel and HTML reports, and automatically sends them via email and DingTalk alerts for operational monitoring.

Email Automationdingtalklog monitoring
0 likes · 30 min read
Automating Log Monitoring, Email Reporting, and DingTalk Alerts with Python
Java Captain
Java Captain
Nov 29, 2023 · Operations

Setting Up Nginx Access Log Monitoring with Loki and Grafana

This guide walks through installing Nginx, configuring Promtail and Loki to collect JSON‑formatted access logs, adding GeoIP support, deploying Grafana via Docker, connecting the Loki data source, and creating a dashboard with the world‑map panel to visualize website traffic.

GeoIPGrafanaJSON Logs
0 likes · 8 min read
Setting Up Nginx Access Log Monitoring with Loki and Grafana
Top Architect
Top Architect
Aug 14, 2023 · Operations

Setting Up Nginx Log Collection and Visualization with Promtail, Loki, and Grafana

This guide explains how to collect Nginx access logs, convert them to JSON, ship them with Promtail to Loki, and visualize the data in Grafana, including installation steps, configuration snippets, GeoIP setup, and dashboard customization for a complete observability solution.

GrafanaLokiNginx
0 likes · 9 min read
Setting Up Nginx Log Collection and Visualization with Promtail, Loki, and Grafana
NetEase LeiHuo Testing Center
NetEase LeiHuo Testing Center
Jul 28, 2023 · Backend Development

Automation Testing Practices and Tool Development for Game Development

The article shares practical experiences and techniques for game testing automation, covering fake player usage, script modularization, report generation, IDE template utilization, custom log tools, and developer habits to improve efficiency and code quality across testing workflows.

Automation TestingGame developmentcoding practices
0 likes · 18 min read
Automation Testing Practices and Tool Development for Game Development
NetEase Cloud Music Tech Team
NetEase Cloud Music Tech Team
Jul 10, 2023 · Big Data

Design and Implementation of the Log Reporting, Collection, and Distribution Pipeline in NetEase Cloud Music's Corona Front‑end Monitoring System

The article details NetEase Cloud Music’s Corona monitoring pipeline, explaining how SDKs report logs via an HTTP service, how a transmission layer normalizes and stores them, how a Flume‑like collector forwards logs to HBase and Kafka, and how Flink tasks shard and filter streams for various monitoring services while handling traffic spikes and offering an independent Node.js channel for other business units.

FlinkKafkadistributed systems
0 likes · 10 min read
Design and Implementation of the Log Reporting, Collection, and Distribution Pipeline in NetEase Cloud Music's Corona Front‑end Monitoring System
Efficient Ops
Efficient Ops
May 29, 2023 · Cloud Native

Master Real-Time Kubernetes Logs with Kubetail and Stern

Learn how to efficiently monitor Kubernetes workloads by deploying log agents and using two powerful real‑time log aggregation tools—Kubetail and Stern—including installation steps, usage examples, and detailed command‑line options for filtering, coloring, and exporting logs across multiple pods and containers.

CLI toolsKubernetescloud native
0 likes · 12 min read
Master Real-Time Kubernetes Logs with Kubetail and Stern
37 Interactive Technology Team
37 Interactive Technology Team
Dec 8, 2022 · Operations

Log Alarm Optimization and Grafana Chart Integration Guide

This guide details how to configure Alibaba Cloud Log Service alarms—setting one‑day tokens, handling 1024‑byte truncation, removing record limits with analysis statements, adding a 10‑second query offset for timeliness—and shows how to visualize the data in Grafana using SQL queries for multi‑line and pie charts with timestamp conversion and time‑series filling.

GrafanaSQLalert optimization
0 likes · 6 min read
Log Alarm Optimization and Grafana Chart Integration Guide
DataFunTalk
DataFunTalk
Jun 23, 2022 · Big Data

Real‑Time Low‑Latency Log Monitoring and Storage at Ctrip: Architecture, Clog System, CAT Tracing, and TSDB

This article details Ctrip's large‑scale, real‑time log monitoring solution, covering the overall monitoring architecture, the Clog log system, the CAT tracing platform, and the TSDB metric store, and explains design choices such as write‑heavy indexing, segment‑based storage, and migration to ClickHouse for high‑cardinality data.

Big DataIndexingReal-time Processing
0 likes · 11 min read
Real‑Time Low‑Latency Log Monitoring and Storage at Ctrip: Architecture, Clog System, CAT Tracing, and TSDB
Yiche Technology
Yiche Technology
Mar 9, 2022 · Cloud Native

Design and Implementation of the Yunji Logging System Using Flink and ClickHouse

The article presents the Yunji logging system, a Flink+ClickHouse-based cloud-native platform for real-time ingestion, storage, querying, analysis, and monitoring of massive heterogeneous logs, covering its architecture, configuration center, storage design, processing flow, monitoring features, and future enhancements.

ClickHouseFlinkJanino
0 likes · 21 min read
Design and Implementation of the Yunji Logging System Using Flink and ClickHouse
Efficient Ops
Efficient Ops
Feb 20, 2022 · Operations

How to Monitor Nginx Logs with ELK: From Logstash Config to Kibana Dashboards

This guide walks through setting up an ELK stack to collect, parse, and visualize Nginx access logs, covering Logstash configuration, Grok patterns, Elasticsearch setup, Nginx proxy with basic authentication, and creating Kibana dashboards for log analysis.

ELKElasticsearchKibana
0 likes · 12 min read
How to Monitor Nginx Logs with ELK: From Logstash Config to Kibana Dashboards
Efficient Ops
Efficient Ops
Jan 27, 2022 · Operations

Master Real-Time Log Monitoring on Linux with Tail, Multitail, Lnav & Less

Learn how to instantly watch and follow log files on Linux using tools like tail, tailf, tail -F, multitail, lnav, and less, with installation tips, command options, and practical examples for both single and multiple log streams.

LessLinuxlnav
0 likes · 6 min read
Master Real-Time Log Monitoring on Linux with Tail, Multitail, Lnav & Less
NetEase LeiHuo Testing Center
NetEase LeiHuo Testing Center
Nov 19, 2021 · Game Development

Analyzing and Debugging Combat Attribute and Skill Anomalies in Online Games

This article explains how game QA teams can systematically investigate player‑reported damage and attribute anomalies by understanding combat value structures, implementing attribute and skill‑settlement logging, and applying automated analysis to identify and resolve bugs that affect gameplay balance.

Game developmentQAattribute analysis
0 likes · 13 min read
Analyzing and Debugging Combat Attribute and Skill Anomalies in Online Games
IT Architects Alliance
IT Architects Alliance
Nov 11, 2021 · Operations

Design and Implementation of a TB‑Scale Log Monitoring System Using the ELK Stack

This article explains how to build a terabyte‑level log monitoring platform for micro‑service environments by unifying log collection with FileBeat, enriching observability through Elastic APM, processing streams via Kafka Streams, and visualizing metrics with Grafana and Kibana, while addressing cost‑effective filtering and retention strategies.

ELK StackGrafanaKafka Streams
0 likes · 8 min read
Design and Implementation of a TB‑Scale Log Monitoring System Using the ELK Stack
Architecture Digest
Architecture Digest
Oct 21, 2021 · Operations

Building a TB‑Scale Log Monitoring System with ELK Stack

This article explains how to design and implement a TB‑level log monitoring system for microservice environments using the ELK stack, detailing log collection with FileBeat, tracing via Elastic APM, resource‑efficient processing with Kafka Streams, and visualization through Grafana and Kibana.

ELKFilebeatGrafana
0 likes · 8 min read
Building a TB‑Scale Log Monitoring System with ELK Stack