Skip to content
Tagged articles

log analysis

258 articles · Page 2 of 3
vivo Internet Technology
vivo Internet Technology
Oct 30, 2024 · Operations

Troubleshooting TiKV Disk Space Issues: Causes, Diagnosis, and Solutions

This guide explains how to diagnose and fix TiKV disk‑space problems by identifying oversized log files, redundant space‑placeholder files, and excessive RocksDB/Titan data, offering command‑line checks, configuration tweaks such as enabling log rotation, disabling reserve space, and tuning GC and Titan discardable‑ratio to restore balanced storage.

StorageTiKVconfiguration
0 likes · 16 min read
Troubleshooting TiKV Disk Space Issues: Causes, Diagnosis, and Solutions
Alibaba Cloud Big Data AI Platform
Alibaba Cloud Big Data AI Platform
Oct 23, 2024 · Cloud Computing

How Elasticsearch Serverless Cuts Log Analysis Costs by 50%

At the 2024 Cloud Xi Conference, Alibaba Cloud expert Jia Xinyu detailed how Elasticsearch Serverless addresses core log‑analysis pain points with out‑of‑the‑box, high‑performance, pay‑as‑you‑go capabilities, delivering significant cost savings and eliminating operational overhead.

Elasticsearchcloud computingcost optimization
0 likes · 14 min read
How Elasticsearch Serverless Cuts Log Analysis Costs by 50%
Test Development Learning Exchange
Test Development Learning Exchange
Oct 22, 2024 · Operations

Comprehensive Guide to Collecting Information, Reproducing Issues, Analyzing Logs and Code, Narrowing Problem Scope, and Team Communication

This guide outlines systematic steps for gathering environment and error details, reproducing bugs across different setups, analyzing logs and source code, narrowing down problem areas, and effectively communicating with developers, product managers, testers, on‑site staff, and customers to resolve software issues.

Debuggingbug troubleshootinglog analysis
0 likes · 6 min read
Comprehensive Guide to Collecting Information, Reproducing Issues, Analyzing Logs and Code, Narrowing Problem Scope, and Team Communication
Java Architecture Stack
Java Architecture Stack
Oct 15, 2024 · Backend Development

How to Build Powerful Search, Log, and Recommendation Solutions with Elasticsearch

This guide walks through five real‑world Elasticsearch use cases—including full‑text product search with highlighting, centralized log collection and analysis, personalized video recommendation, price‑range aggregation for e‑commerce, and geo‑location restaurant search—detailing index design, query syntax, Docker setup, and front‑end integration.

ElasticsearchPrice AggregationRecommendation System
0 likes · 35 min read
How to Build Powerful Search, Log, and Recommendation Solutions with Elasticsearch
DevOps Operations Practice
DevOps Operations Practice
Jul 8, 2024 · Operations

Common Linux Log Files and Useful Commands for Log Analysis

This article introduces common Linux log files, essential command‑line utilities such as cat, less, tail, grep, awk, and sed for viewing logs, and powerful analysis tools like logrotate, journalctl, logwatch, and goaccess, providing practical examples for effective system log management.

log analysislog managementsystem-administration
0 likes · 7 min read
Common Linux Log Files and Useful Commands for Log Analysis
Liangxu Linux
Liangxu Linux
Jun 2, 2024 · Operations

Essential Shell Commands for Analyzing Apache Access Logs

A comprehensive collection of awk, grep, sort, and netstat one‑liners that help you count unique IPs, rank pages by hits, filter by time ranges, identify slow requests, and monitor connection states directly from Apache log files.

ApacheNetwork MonitoringShell Commands
0 likes · 11 min read
Essential Shell Commands for Analyzing Apache Access Logs
Efficient Ops
Efficient Ops
May 8, 2024 · Information Security

How to Detect and Recover from Linux Server Intrusions: 11 Essential Checks

This guide walks Linux operations engineers through eleven practical checks—including log inspection, user file verification, login event analysis, network traffic monitoring, and file recovery via lsof—to identify and remediate compromised machines effectively.

LinuxSecurityintrusion-detection
0 likes · 7 min read
How to Detect and Recover from Linux Server Intrusions: 11 Essential Checks
Liangxu Linux
Liangxu Linux
May 6, 2024 · Operations

Master Fast Log Error Detection with Tail, Grep, and Sed Commands

This guide shows how to quickly locate errors in massive log files using Linux commands such as tail, head, grep, and sed, offering multiple techniques—including line‑number extraction, time‑range queries, match counting, colored highlights, and pagination—to streamline debugging and log analysis.

DebuggingLinuxcommand line
0 likes · 12 min read
Master Fast Log Error Detection with Tail, Grep, and Sed Commands
Alibaba Cloud Native
Alibaba Cloud Native
Apr 16, 2024 · Operations

Unlocking Log Insights: How SPL Brings Interactive Pipe‑Style Queries to Cloud‑Native Observability

This article explains how the SLS Processing Language (SPL) enables interactive, pipeline‑based log analysis in cloud‑native environments, covering the challenges of unstructured log data, Unix‑inspired exploration, SPL syntax, key commands, and practical examples for efficient querying and transformation.

Cloud NativePipelineSPL
0 likes · 12 min read
Unlocking Log Insights: How SPL Brings Interactive Pipe‑Style Queries to Cloud‑Native Observability
Sohu Tech Products
Sohu Tech Products
Jan 31, 2024 · Operations

Logstash Grok Filter: Complete Guide for Log Data Parsing and ETL

This guide explains Logstash’s Grok filter plugin, detailing how its 120 built‑in and custom patterns transform unstructured logs—such as Apache, MySQL, or HiveServer2—into structured fields through named regex captures, supporting type conversion, cleaning, debugging, and efficient ETL for analysis and monitoring.

ETLGrok filterLogstash
0 likes · 8 min read
Logstash Grok Filter: Complete Guide for Log Data Parsing and ETL
Open Source Linux
Open Source Linux
Dec 28, 2023 · Operations

Master Logwatch: Install and Analyze Linux Logs Efficiently

This guide explains why manual log review is tedious, introduces Logwatch as an automated solution, walks through installing it on CentOS, configuring its core settings, running it manually, and interpreting its concise email reports to simplify Linux system log management.

CentOSLinuxlog analysis
0 likes · 7 min read
Master Logwatch: Install and Analyze Linux Logs Efficiently
Liangxu Linux
Liangxu Linux
Nov 15, 2023 · Operations

How to Install and Use Logwatch for Automated Linux Log Analysis

This guide explains why manual log inspection is tedious, introduces Logwatch as a solution, and provides step‑by‑step commands to install it on CentOS, configure its settings, run analyses instantly, and interpret the generated reports.

CentOScronlog analysis
0 likes · 9 min read
How to Install and Use Logwatch for Automated Linux Log Analysis
Aikesheng Open Source Community
Aikesheng Open Source Community
Nov 8, 2023 · Databases

Analyzing OceanBase Freeze Dump Process via Log Parsing

This article explains how to parse OceanBase logs to trace the tenant freeze dump workflow, detailing the roles and log sequences of the freeze check thread, LSFreeze, Flush, DagScheduler, and MiniMerge threads, and illustrating each step with actual log excerpts and code snippets.

DAGFreeze ProcessOceanBase
0 likes · 16 min read
Analyzing OceanBase Freeze Dump Process via Log Parsing
DataFunTalk
DataFunTalk
Oct 21, 2023 · Operations

Implementing Nginx Operations Management with the Honghu Platform: A Practical Case Study

This article presents a detailed, end‑to‑end case study of how Yanhuang Data leveraged the Honghu data‑analysis platform to build a complete Nginx operations‑management solution, covering data ingestion, parsing, modeling, visualization, alerting, third‑party integration, and best‑practice recommendations.

Operations Managementalertinglog analysis
0 likes · 15 min read
Implementing Nginx Operations Management with the Honghu Platform: A Practical Case Study
Huolala Tech
Huolala Tech
Sep 19, 2023 · Information Security

How to Detect and Block Malicious Bot Traffic Using Log Analysis

This guide explains how to identify and differentiate malicious bot traffic from legitimate requests by analyzing web server logs, leveraging fields such as IP, user‑agent, referer, and parameters, and then applying WAF rules, automation, and security platforms to mitigate attacks and improve operational metrics.

AutomationWAFWeb Security
0 likes · 31 min read
How to Detect and Block Malicious Bot Traffic Using Log Analysis
Open Source Linux
Open Source Linux
Sep 6, 2023 · Operations

Master Logwatch: Install and Automate Linux Log Analysis on CentOS

Logwatch, a built‑in CentOS log analysis tool, can be installed via yum, configured by copying the default config, and scheduled through cron to automatically email root daily summaries of system logs, simplifying server monitoring and reducing manual log inspection.

System Monitoringcronlog analysis
0 likes · 7 min read
Master Logwatch: Install and Automate Linux Log Analysis on CentOS
Efficient Ops
Efficient Ops
Aug 28, 2023 · Operations

How to Build a Real‑Time ELK Log Analysis Platform for Scalable Operations

This article explains why centralized logging is essential for modern micro‑service systems, outlines an ELK‑based architecture with Filebeat, Kafka, Logstash, Elasticsearch and Kibana, and provides detailed configuration examples for both file‑based and Kubernetes‑based log collection, plus visualization techniques.

ElasticsearchKibanaKubernetes
0 likes · 10 min read
How to Build a Real‑Time ELK Log Analysis Platform for Scalable Operations
Test Development Learning Exchange
Test Development Learning Exchange
Aug 23, 2023 · Operations

Server Monitoring Strategies and Tools Using Python

This article outlines key strategies and Python tools for server monitoring, including defining metrics, utilizing libraries like psutil and requests, log analysis, load testing with Locust and PyTest, and implementing automated alerts for high availability.

High AvailabilityPythonload testing
0 likes · 4 min read
Server Monitoring Strategies and Tools Using Python
MaGe Linux Operations
MaGe Linux Operations
Aug 23, 2023 · Operations

Master Logwatch: Install and Automate Linux Log Analysis on CentOS

This guide explains why log analysis is essential for Linux system health, walks through installing Logwatch on CentOS, configuring its core settings, automating daily runs via cron, and interpreting sample output for connections, SSH activity, package installs, and disk usage.

CentOSlog analysislogwatch
0 likes · 8 min read
Master Logwatch: Install and Automate Linux Log Analysis on CentOS
DataFunSummit
DataFunSummit
Aug 17, 2023 · Artificial Intelligence

Research and Applications of Large Language Models in ICT Operations

This presentation explores the fundamental concepts of large language models, their evolution in natural language processing for ICT, practical applications in log‑driven operations, experimental results of models like BigLog and LogXXX, and future visions for AI‑driven autonomous operation.

AIICT operationslog analysis
0 likes · 10 min read
Research and Applications of Large Language Models in ICT Operations
Liangxu Linux
Liangxu Linux
Jul 2, 2023 · Operations

Master Server Log Analysis with Powerful Bash Commands

This guide presents a comprehensive collection of Bash one‑liners—using awk, grep, sort, uniq, netstat, and other utilities—to count unique IPs, rank page visits, filter bots, analyze traffic by time windows, compute bandwidth, and monitor connection states from Apache or Nginx access logs.

awkbashgrep
0 likes · 12 min read
Master Server Log Analysis with Powerful Bash Commands
DataFunTalk
DataFunTalk
May 19, 2023 · Big Data

Log Analysis and Schema‑On‑Read: Design and Implementation of the Honghu Real‑Time Heterogeneous Data Platform

This article examines the challenges and value of log analysis, introduces the concepts of schema‑on‑read versus schema‑on‑write, and details how the Honghu platform implements real‑time, one‑stop heterogeneous data analytics with flexible storage, indexing, and SQL‑based query engines.

log analysisreal-time analyticsschema on read
0 likes · 24 min read
Log Analysis and Schema‑On‑Read: Design and Implementation of the Honghu Real‑Time Heterogeneous Data Platform
Open Source Linux
Open Source Linux
May 4, 2023 · Operations

Master Fast Log Error Detection with Tail, Grep, and Sed Commands

This guide shows how to quickly pinpoint errors in massive log files on Linux by using dynamic viewing commands such as tail and head, extracting line numbers with grep, searching within time ranges using sed, counting matches, highlighting results, and navigating logs with pagination tools like more and less.

Shell Commandsgreplog analysis
0 likes · 12 min read
Master Fast Log Error Detection with Tail, Grep, and Sed Commands
ITPUB
ITPUB
Apr 26, 2023 · Information Security

Detecting CDK Attacks with Kubernetes Audit Logs: Practical Rules and Pitfalls

This article explains how to enable Kubernetes audit logging, analyzes CDK‑based attack behaviors captured in audit logs, provides concrete detection rules for information collection, exploitation, and privilege escalation, and shares practical lessons learned when deploying audit‑driven security in cloud‑native environments.

CDKKubernetesaudit logs
0 likes · 18 min read
Detecting CDK Attacks with Kubernetes Audit Logs: Practical Rules and Pitfalls
Liangxu Linux
Liangxu Linux
Mar 26, 2023 · Operations

Quick Techniques to Pinpoint Errors in Massive Log Files

Learn how to efficiently navigate, filter, and extract specific entries from large log files using tail, head, grep, sed, and pagination commands, with practical examples for locating error lines and time ranges.

Linuxcommand linegrep
0 likes · 11 min read
Quick Techniques to Pinpoint Errors in Massive Log Files
Liangxu Linux
Liangxu Linux
Mar 19, 2023 · Operations

Master Log Analysis: Fast Linux Commands to Pinpoint Errors

This guide shows programmers how to quickly locate errors in massive server logs using essential Linux commands such as tail, cat, grep, sed, and pagination tools, providing step‑by‑step examples and tips for efficient debugging.

DebuggingLinuxShell Commands
0 likes · 12 min read
Master Log Analysis: Fast Linux Commands to Pinpoint Errors
Efficient Ops
Efficient Ops
Mar 14, 2023 · Artificial Intelligence

How NetEase Games Built an AIOps Platform to Transform IT Operations

This article explains how NetEase Games leveraged AI, big data, and machine learning to create an AIOps platform that automates anomaly detection, log analysis, and fault localization, improving quality assurance, cost management, and operational efficiency across complex gaming infrastructures.

AIOpsIT Operationsanomaly detection
0 likes · 12 min read
How NetEase Games Built an AIOps Platform to Transform IT Operations
Liangxu Linux
Liangxu Linux
Mar 12, 2023 · Operations

Master Apache Log Analysis with Powerful AWK and Netstat Commands

This guide presents a comprehensive collection of AWK, grep, sed, and netstat one‑liners that let you count unique IPs, rank page visits, measure bandwidth, monitor TCP states, and extract detailed traffic patterns from Apache access logs on Linux systems.

ApacheLinuxNetwork Monitoring
0 likes · 11 min read
Master Apache Log Analysis with Powerful AWK and Netstat Commands
AntTech
AntTech
Mar 7, 2023 · Cloud Native

Introduction to HoloInsight: A Cloud‑Native Lightweight Observability Platform

HoloInsight is an open‑source, cloud‑native observability platform derived from Ant Group's AntMonitor, offering integrated log‑based monitoring, business metric analysis, and AI‑driven AIOps capabilities while providing a lightweight, modular architecture and extensive extensibility for modern software stacks.

AIOpscloud-nativelog analysis
0 likes · 13 min read
Introduction to HoloInsight: A Cloud‑Native Lightweight Observability Platform
Python Programming Learning Circle
Python Programming Learning Circle
Mar 6, 2023 · Operations

Intelligent Operations: AI‑Driven Anomaly Detection, Alarm Compression, and Log Analysis Techniques

This article presents an AI‑enhanced operations framework that combines metric anomaly detection, alarm compression, log anomaly detection, and intelligent analysis using machine learning methods such as DBSCAN clustering, SARIMAX modeling, Apriori association rules, and LSTM‑based log parsing to improve fault detection and reduce operational costs.

AIOpsanomaly detectionlog analysis
0 likes · 15 min read
Intelligent Operations: AI‑Driven Anomaly Detection, Alarm Compression, and Log Analysis Techniques
Su San Talks Tech
Su San Talks Tech
Dec 21, 2022 · Information Security

Block Malicious IPs on a Small Linux Site with iptables and Cron

This guide explains how to detect traffic attacks on a low‑traffic Linux website, split Nginx logs daily, identify IPs with excessive requests, and automatically block them using iptables rules scheduled via cron, complete with ready‑to‑run Bash scripts and common firewall commands.

DDoS MitigationLinuxbash
0 likes · 9 min read
Block Malicious IPs on a Small Linux Site with iptables and Cron
Efficient Ops
Efficient Ops
Nov 20, 2022 · Information Security

How to Detect and Recover from Linux Server Intrusions: Essential Checks

This guide outlines eleven practical steps for Linux system administrators to identify signs of compromise—such as missing logs, altered password files, unusual login activity, abnormal traffic, and deleted files—and provides command examples for detection and recovery.

LinuxSecurityfile recovery
0 likes · 7 min read
How to Detect and Recover from Linux Server Intrusions: Essential Checks
Tencent Cloud Developer
Tencent Cloud Developer
Nov 15, 2022 · Operations

Detecting and Resolving CCN Bandwidth Issues with CLS Log Analytics

This article walks through how an online education operator uses Tencent Cloud Log Service to monitor Cloud Connect Network flow logs, set reject‑traffic alerts, analyze regional, IP, and protocol distributions, track bandwidth trends, and finally expand bandwidth to eliminate service interruptions.

CCNCLSNetwork Monitoring
0 likes · 6 min read
Detecting and Resolving CCN Bandwidth Issues with CLS Log Analytics
Liangxu Linux
Liangxu Linux
Oct 30, 2022 · Operations

Essential Linux Commands for Analyzing Web Server Logs

A comprehensive collection of practical Linux one‑liners—using awk, grep, sort, uniq, and netstat—to count unique IPs, track page visits, rank URLs, monitor connection states, and measure traffic from Apache access logs for effective server operations.

Linuxawkgrep
0 likes · 13 min read
Essential Linux Commands for Analyzing Web Server Logs
LOFTER Tech Team
LOFTER Tech Team
Oct 26, 2022 · Operations

Efficient Nginx Log Analysis Using GoAccess and Practical Case Studies

This article explains why Nginx logs are critical, compares various log‑analysis tools, provides detailed installation and configuration steps for GoAccess, discusses selection criteria, and shares real‑world case studies that demonstrate how to extract valuable system and business insights from massive access logs.

GoAccesslog analysismonitoring
0 likes · 20 min read
Efficient Nginx Log Analysis Using GoAccess and Practical Case Studies
Open Source Linux
Open Source Linux
Oct 19, 2022 · Backend Development

From Monolith to Microservices: A Practical Evolution Guide

This article walks through the step‑by‑step transformation of a simple online supermarket from a monolithic web app to a fully‑featured microservice architecture, covering common pitfalls, component choices, monitoring, tracing, logging, service discovery, fault‑tolerance, testing, and deployment strategies.

Service Discoverycircuit breakerlog analysis
0 likes · 22 min read
From Monolith to Microservices: A Practical Evolution Guide
Liangxu Linux
Liangxu Linux
Oct 19, 2022 · Operations

Essential Linux Commands for Analyzing Web Server Logs

This guide compiles practical Linux shell commands for extracting IP counts, page visit frequencies, time‑range queries, bandwidth usage, HTTP status distribution, and TCP connection states from Apache or Nginx access logs, helping administrators quickly spot traffic patterns, bottlenecks, and potential attacks.

ApacheLinuxNetwork Monitoring
0 likes · 12 min read
Essential Linux Commands for Analyzing Web Server Logs
Efficient Ops
Efficient Ops
Oct 8, 2022 · Operations

Master Server Log Analysis: 30 Essential Linux Commands for Monitoring Traffic

This guide compiles a comprehensive set of Linux command‑line techniques—using awk, grep, netstat, and other tools—to help you count unique IPs, track page visits, identify heavy‑traffic files, monitor connection states, and extract performance metrics from Apache and other web server logs.

awklog analysisnetstat
0 likes · 14 min read
Master Server Log Analysis: 30 Essential Linux Commands for Monitoring Traffic
Baidu Geek Talk
Baidu Geek Talk
Sep 20, 2022 · Mobile Development

APP Speed Evaluation Methods and the LazyPerf Tool

The article reviews log‑based, manual, and automated app speed evaluation methods, highlights their trade‑offs, and introduces LazyPerf—a platform that records real‑device interactions, uses resilient widget addressing and built‑in frame detection to dramatically cut automation scripting and calibration effort while improving scalability of performance testing.

Speed Testingapp performancelazyperf
0 likes · 14 min read
APP Speed Evaluation Methods and the LazyPerf Tool
NetEase Game Operations Platform
NetEase Game Operations Platform
Sep 19, 2022 · Artificial Intelligence

Applying AIOps to Game Operations: Roadmap, Anomaly Detection, and Fault Localization

This article describes NetEase's AIOps journey for game operations, explaining the Gartner definition of intelligent operations, the implementation roadmap, detailed anomaly‑detection techniques for business, performance, and log data, and a comprehensive fault‑localization workflow that combines resource, code, and historical analysis.

AIOpsanomaly detectionfault localization
0 likes · 12 min read
Applying AIOps to Game Operations: Roadmap, Anomaly Detection, and Fault Localization
Aikesheng Open Source Community
Aikesheng Open Source Community
Sep 5, 2022 · Databases

Investigation of DBLE "no handler" Log Entries and MySQL Connection‑Timeout Error Handling

This article investigates why DBLE repeatedly logs "no handler" messages by analyzing DBLE and MySQL logs, using Arthas to trace the call chain, reproducing the scenario with timeout settings, capturing network traffic, and explaining the MySQL 8.0.24 error‑packet behavior that leads to the observed logs.

ArthasDBLEbackend development
0 likes · 12 min read
Investigation of DBLE "no handler" Log Entries and MySQL Connection‑Timeout Error Handling
JD Tech
JD Tech
Aug 26, 2022 · Information Security

API Security Governance and Authentication Practices in JD Logistics Sorting Platform

This article examines security challenges encountered in JD Logistics' sorting platform, details the investigative process for abnormal API requests, proposes a SHA‑256 based authentication scheme with digital signatures, compares industry‑wide API protection methods, and shares practical insights from the author's experience in financial API gateway design.

API SecurityAuthenticationIndustry Comparison
0 likes · 15 min read
API Security Governance and Authentication Practices in JD Logistics Sorting Platform
Efficient Ops
Efficient Ops
Aug 17, 2022 · Operations

Master System Monitoring with the USE Method and Prometheus

This article explains how to build a comprehensive monitoring system using the concise USE (Utilization, Saturation, Errors) method, outlines key system and application metrics, and demonstrates practical implementation with Prometheus, Grafana, full‑link tracing, and ELK for observability and performance troubleshooting.

Full‑Link TracingPrometheusSystem Performance
0 likes · 13 min read
Master System Monitoring with the USE Method and Prometheus
Ctrip Technology
Ctrip Technology
Aug 4, 2022 · Backend Development

Design and Evolution of Ctrip Ticket Frontend Trace System for Efficient Debugging

The article describes how Ctrip built and continuously improved a Trace system for its ticket‑front‑end microservices, detailing the challenges of distributed logs, the architecture of the solution, and the functional features such as friendly search, multi‑platform aggregation, page replay, and one‑click mock that together boost debugging efficiency for both developers and non‑technical operators.

Backendlog analysismicroservices
0 likes · 13 min read
Design and Evolution of Ctrip Ticket Frontend Trace System for Efficient Debugging
Liangxu Linux
Liangxu Linux
Jul 26, 2022 · Fundamentals

7 Practical Shell Script Examples to Boost Your Linux Automation Skills

This article presents seven ready‑to‑use Bash scripts that demonstrate parallel host querying, process statistics gathering, file renaming, directory management, log analysis, network request monitoring, and file size sorting, each with complete code and step‑by‑step explanations.

Automationlog analysisprocess monitoring
0 likes · 8 min read
7 Practical Shell Script Examples to Boost Your Linux Automation Skills
Dada Group Technology
Dada Group Technology
Jun 20, 2022 · Information Security

Design and Implementation of JD Daojia Security Operations Center (SOC) Platform

This article details the challenges, design choices, deployment steps, detection model creation, data processing, visualization, and future plans of JD Daojia's security operations platform, highlighting the use of Graylog, Elasticsearch, and MongoDB to achieve scalable, real‑time threat detection and response.

GraylogSOCdata visualization
0 likes · 16 min read
Design and Implementation of JD Daojia Security Operations Center (SOC) Platform
Open Source Linux
Open Source Linux
Jan 17, 2022 · Information Security

Mastering Incident Response: A Step‑by‑Step Guide for Security Professionals

This comprehensive guide walks security engineers through every phase of an incident response—from initial information gathering, containment, and vulnerability scanning to detailed log, process, and account analysis, culminating in recovery steps and post‑incident hardening recommendations.

Malware Analysisforensicslog analysis
0 likes · 28 min read
Mastering Incident Response: A Step‑by‑Step Guide for Security Professionals
Efficient Ops
Efficient Ops
Dec 14, 2021 · Operations

20 Essential Linux Commands for Server Log Analysis and Threat Detection

This guide compiles a comprehensive set of Linux shell commands that let you examine web server logs, count unique IPs, identify top‑requested pages, filter bots, monitor connection states, and spot performance or security anomalies, helping you keep your site secure and performant.

ApacheNetwork MonitoringShell Commands
0 likes · 13 min read
20 Essential Linux Commands for Server Log Analysis and Threat Detection
Baidu Geek Talk
Baidu Geek Talk
Nov 24, 2021 · Operations

How Baidu’s Fengjing Uses Holographic Logs to Debug Massive Microservices

Baidu’s Fengjing monitoring platform tackles the daunting challenge of pinpointing failures in its massive Java‑based microservice ecosystem by employing a non‑intrusive probe that captures log metadata, stores it in a database, and reconstructs full request‑level logs with minimal storage overhead.

Javadistributed tracingholographic logging
0 likes · 9 min read
How Baidu’s Fengjing Uses Holographic Logs to Debug Massive Microservices
Tencent Cloud Developer
Tencent Cloud Developer
Aug 17, 2021 · Big Data

Elasticsearch Technical Event in Shenzhen

The Shenzhen Elasticsearch technical event, co‑hosted by the Elastic Chinese community and Tencent Cloud, presented practical sessions on optimizing the Elastic Stack for search, real‑time analytics, logging, security and APM, featuring compression encoding, MongoDB fusion, ByteDance extensions, cost‑effective log storage, Lucene indexing, cross‑cluster replication, vector engine integration, and large‑scale case studies from Tencent, Tiptop Data and vivo.

ElasticsearchMongoDBVector Computing
0 likes · 4 min read
Elasticsearch Technical Event in Shenzhen
GrowingIO Tech Team
GrowingIO Tech Team
Jul 22, 2021 · Databases

How to Diagnose and Fix Common HBase RegionServer Crashes

This article examines frequent HBase RegionServer failures caused by long GC pauses, oversized scans, and HDFS decommissioning, outlines step‑by‑step troubleshooting procedures—including log searches, GC tuning, scan size limits, and monitoring strategies—and provides practical solutions to prevent and resolve these issues.

GCHBaseRegionServer
0 likes · 14 min read
How to Diagnose and Fix Common HBase RegionServer Crashes
Yuewen Technology
Yuewen Technology
Jul 16, 2021 · Operations

Mastering Log Aggregation: From LogID Generation to Powerful Analysis Tools

This article explores the challenges of log aggregation in micro‑service architectures, introduces a globally unique log identifier (logid) with its required properties, compares various logid generation schemes, and presents end‑to‑end solutions for log distribution, aggregation, and analysis using custom tools such as ylog and watcher.

Distributed Systemslog aggregationlog analysis
0 likes · 26 min read
Mastering Log Aggregation: From LogID Generation to Powerful Analysis Tools
macrozheng
macrozheng
Jul 7, 2021 · Operations

Query Linux Logs with SQL Using the ‘q’ Command-Line Tool

The article introduces the command‑line utility q, explains how to install it on Linux and Windows, and demonstrates using familiar SQLite‑style SQL queries to search, filter, join, and aggregate log files and command output, offering a convenient alternative to traditional shell tools.

LinuxSQLcommand-line
0 likes · 10 min read
Query Linux Logs with SQL Using the ‘q’ Command-Line Tool
Liangxu Linux
Liangxu Linux
Jun 23, 2021 · Operations

Query Linux Logs with SQL Using the ‘q’ Tool – A Practical Guide

This article introduces the command‑line utility q, explains how to install it on Linux and Windows, and demonstrates using full SQLite‑compatible SQL syntax to query, filter, join, and aggregate plain‑text log files, offering a database‑style alternative to traditional shell tools.

LinuxSQLcommand-line
0 likes · 10 min read
Query Linux Logs with SQL Using the ‘q’ Tool – A Practical Guide
Efficient Ops
Efficient Ops
Jun 23, 2021 · Backend Development

Why Can’t Elasticsearch Find My Logs? Uncovering Full‑Text Search Pitfalls and Tokenizer Tweaks

This article explains why large‑scale Elasticsearch clusters may miss log entries during keyword searches, dives into the fundamentals of inverted indexes and tokenization, and demonstrates practical index‑time and query‑time tokenizer optimizations—including custom analyzers for English and Chinese—to dramatically improve search recall and precision.

ElasticsearchInverted IndexSearch Optimization
0 likes · 13 min read
Why Can’t Elasticsearch Find My Logs? Uncovering Full‑Text Search Pitfalls and Tokenizer Tweaks
Efficient Ops
Efficient Ops
Apr 26, 2021 · Information Security

Deploying WAF-FLE: A Step‑by‑Step Guide to Managing ModSecurity Logs

This article walks you through installing and configuring the open‑source WAF‑FLE console—written in PHP—to collect, search, and visualize ModSecurity logs on Apache or Nginx, covering environment setup, database creation, sensor configuration, and troubleshooting common integration issues.

ModSecurityPHPWAF-FLE
0 likes · 8 min read
Deploying WAF-FLE: A Step‑by‑Step Guide to Managing ModSecurity Logs
FunTester
FunTester
Mar 16, 2021 · Operations

How to Capture Per‑API Response Times in Load Tests with Groovy Scripts

This article explains how to extend a performance testing framework to record and visualize individual HTTP interface latencies by parsing consolidated logs, grouping timings by URL, and using a Groovy script with StatisticsUtil to generate response‑time charts.

BackendGroovyload testing
0 likes · 5 min read
How to Capture Per‑API Response Times in Load Tests with Groovy Scripts
MaGe Linux Operations
MaGe Linux Operations
Feb 10, 2021 · Operations

Master Server Log Analysis with Powerful Bash One‑Liners

This guide presents a comprehensive set of Bash and AWK one‑liners for analyzing web server logs, counting unique IPs, tracking page visits, sorting traffic by time, identifying heavy‑weight requests, monitoring Apache processes, and examining network connection states, helping you detect anomalies and optimize performance.

ApacheNetwork Monitoringawk
0 likes · 13 min read
Master Server Log Analysis with Powerful Bash One‑Liners
Liangxu Linux
Liangxu Linux
Jan 28, 2021 · Operations

Essential Linux Commands for Analyzing Web Server Logs

This guide compiles a series of practical Linux one‑liners—using awk, grep, sort, netstat, and related tools—to count unique IPs, rank page requests, filter bots, monitor connection states, and measure bandwidth, enabling quick forensic analysis of Apache or Nginx access logs.

Network Monitoringawkgrep
0 likes · 12 min read
Essential Linux Commands for Analyzing Web Server Logs
Efficient Ops
Efficient Ops
Jan 20, 2021 · Operations

Log vs Network Data: Which Wins Full‑Link Monitoring in Modern Distributed Systems?

With the shift from monolithic to distributed architectures, this article compares log‑based and network‑data‑based monitoring across data sources, precision, monitoring paths, and implementation methods, concluding that network‑data monitoring offers superior real‑time insight, lower cost, and faster deployment for full‑link observability.

full‑linklog analysismonitoring
0 likes · 11 min read
Log vs Network Data: Which Wins Full‑Link Monitoring in Modern Distributed Systems?
Xianyu Technology
Xianyu Technology
Dec 22, 2020 · Operations

Comprehensive Message Traceability and Real-Time Log Processing for Xianyu

Xianyu’s new Message Quality Platform links client, API, and server logs by a unique messageId, cleans and clusters real‑time telemetry, correlates user behavior, and visualizes abnormal nodes, giving end‑to‑end traceability that cuts incident investigation time by over 90 % and can be applied to other pipelines.

Message Tracingbackend reliabilitylog analysis
0 likes · 8 min read
Comprehensive Message Traceability and Real-Time Log Processing for Xianyu
Huolala Tech
Huolala Tech
Nov 11, 2020 · Information Security

How Red Team Techniques Uncover Phishing Attack Origins: A Step‑by‑Step Guide

This article demonstrates how red‑team methods can be applied to phishing traceability, detailing phishing classifications, email‑header extraction, malicious site analysis, web‑shell decryption, privilege‑escalation techniques, log mining, and attacker attribution to reconstruct the full attack chain.

Webshellemail analysislog analysis
0 likes · 33 min read
How Red Team Techniques Uncover Phishing Attack Origins: A Step‑by‑Step Guide
System Architect Go
System Architect Go
Nov 7, 2020 · Operations

Request Log Analysis System: Collected Fields, Derived Data, and Metrics

This article outlines a request log analysis system that records core request fields, adds proxy‑related data, derives IP‑based ASN and geographic information, parses user‑agent details, and provides comprehensive metrics such as PV/QPS, UV, traffic, latency, status monitoring, and business‑specific insights, all visualized via an ELK‑Kafka architecture.

BackendKafkaMetrics
0 likes · 5 min read
Request Log Analysis System: Collected Fields, Derived Data, and Metrics
Efficient Ops
Efficient Ops
Oct 27, 2020 · Information Security

How to Detect Account Security Threats Using Log Analysis and Alerts

This article explains practical methods for detecting account security threats—such as blacklisted, expired, or abnormal login behaviors—by analyzing Linux and Windows login logs, defining detection rules, and leveraging automated tools to generate timely alerts and reduce security risks.

account securityincident responseinformation security
0 likes · 27 min read
How to Detect Account Security Threats Using Log Analysis and Alerts
FunTester
FunTester
Jun 26, 2020 · Operations

How Testers Can Master Linux for Environment Setup and Debugging

This guide explains why Linux is essential for software testers, outlines how to build test environments, use key commands like tail, grep, top, and vmstat for log analysis and performance monitoring, and offers tips for deeper Linux learning and interview preparation.

LinuxPerformance Monitoringenvironment setup
0 likes · 6 min read
How Testers Can Master Linux for Environment Setup and Debugging