Skip to content
Tagged articles

log analysis

258 articles · Page 3 of 3
WecTeam
WecTeam
Jun 16, 2020 · Frontend Development

Mastering Front‑End Error Logging: From BadJS Collection to Deep Analysis

This article explains why front‑end error logging is essential, how BadJS (JavaScript runtime errors) are captured, enriched, and reported, and provides practical strategies for analyzing logs, handling Script errors, dealing with hybrid WebView environments, and scaling the system with big‑data pipelines.

KibanaPerformance Monitoringbadjs
0 likes · 25 min read
Mastering Front‑End Error Logging: From BadJS Collection to Deep Analysis
Liangxu Linux
Liangxu Linux
Jun 13, 2020 · Operations

Mastering Monitoring: From Basics to Advanced Zabbix Practices

This comprehensive guide explains why monitoring is essential for operations, outlines monitoring goals and methods, reviews a wide range of open‑source tools, details a Zabbix‑based workflow, enumerates key metrics across hardware, system, application, network, security and business layers, and offers practical alerting and interview tips.

alertinglog analysismonitoring
0 likes · 21 min read
Mastering Monitoring: From Basics to Advanced Zabbix Practices
Liangxu Linux
Liangxu Linux
Apr 25, 2020 · Operations

Why Dumping Logs into a DB Fails and How Awk Solves the Problem

The article explains why loading all log data into a database is impractical, outlines three drawbacks—volatile requests, data bloat, and cost—and introduces the lightweight awk tool with concrete command examples to filter and analyze network logs efficiently without a database.

awkdata processinglog analysis
0 likes · 6 min read
Why Dumping Logs into a DB Fails and How Awk Solves the Problem
ITPUB
ITPUB
Mar 9, 2020 · Operations

Step‑by‑Step Guide to Install and Configure SARG for Squid Proxy Log Analysis

This tutorial walks you through installing the GD library, building SARG from source, configuring its key parameters, running reports, using command‑line options, scheduling automated jobs with cron, and troubleshooting common installation and configuration issues for Squid log analysis.

LinuxProxySARG
0 likes · 8 min read
Step‑by‑Step Guide to Install and Configure SARG for Squid Proxy Log Analysis
MaGe Linux Operations
MaGe Linux Operations
Feb 17, 2020 · Operations

How to Efficiently Split and Merge Large Log Files on Linux

When log files grow massive, traditional tools like vim, cat, grep, and awk become slow and memory‑hungry, but Linux’s split command lets you divide a huge file by line count or size, process the pieces individually, and later recombine them, dramatically improving analysis efficiency.

big datafile handlinglog analysis
0 likes · 8 min read
How to Efficiently Split and Merge Large Log Files on Linux
vivo Internet Technology
vivo Internet Technology
Nov 6, 2019 · Big Data

Elasticsearch Optimization Practices at Tencent: An Interview with Tencent Cloud Engineer Chen Xi

In an interview, Tencent Cloud senior engineer Chen Xi explains how Tencent optimizes Elasticsearch for massive log, monitoring, and document search workloads by prioritizing stability through kernel tweaks, boosting performance with scenario‑specific settings, cutting costs via redundant storage trimming and off‑heap indexing, and leveraging rich data‑pipeline components and robust distributed cluster management to lower operational overhead while anticipating future ecosystem growth and community collaboration.

Distributed SearchElasticsearchPerformance Tuning
0 likes · 4 min read
Elasticsearch Optimization Practices at Tencent: An Interview with Tencent Cloud Engineer Chen Xi
Efficient Ops
Efficient Ops
Sep 19, 2019 · Information Security

How to Uncover Hidden Threats: Mastering Web Log Analysis with Secsoso

This guide explains why web log analysis is essential for security, demonstrates how to parse Apache logs, distinguishes normal from malicious requests, and provides practical Secsoso commands for business behavior statistics, traffic monitoring, and detecting attacks such as CC, SQL injection, file inclusion, and XSS.

Web Securitylog analysissecsoso
0 likes · 19 min read
How to Uncover Hidden Threats: Mastering Web Log Analysis with Secsoso
dbaplus Community
dbaplus Community
Jun 3, 2019 · Operations

Top 5 Open‑Source Log Analysis Tools Every Ops Team Should Try

Monitoring network activity and ensuring compliance requires effective log analysis, and this article reviews five open‑source tools—Graylog, Nagios, Elastic Stack, LOGalyze, and Fluentd—detailing their features, strengths, and use cases for operations and security teams.

log analysismonitoring
0 likes · 11 min read
Top 5 Open‑Source Log Analysis Tools Every Ops Team Should Try
dbaplus Community
dbaplus Community
May 6, 2019 · Mobile Development

How Ele.me’s Rider App Achieves End‑to‑End Business Availability Monitoring

This article details Ele.me Logistics' mobile‑app monitoring architecture—E‑Monitor, TimeBomb, Dogger, and EDW—explaining how each layer collects, visualizes, and analyzes business‑level availability data, and showcases a real‑world debugging case that leveraged the stack to resolve an HTTP/2 connectivity bug.

AndroidOkHttpPerformance Optimization
0 likes · 16 min read
How Ele.me’s Rider App Achieves End‑to‑End Business Availability Monitoring
Suning Technology
Suning Technology
Apr 28, 2019 · Big Data

Unlocking Real-Time Big Data Insights: Suning’s Elastic-Powered Smart Retail Journey

The April 27 Elastic Nanjing Technical Exchange, co‑hosted by Suning Technology and the Elastic Chinese community, showcased how Suning leverages Elasticsearch, Logstash, Kibana and Beats for real‑time search, log analysis, security, and smart‑retail applications, featuring expert case studies and future big‑data strategies.

ElasticSmart Retaillog analysis
0 likes · 6 min read
Unlocking Real-Time Big Data Insights: Suning’s Elastic-Powered Smart Retail Journey
Liangxu Linux
Liangxu Linux
Mar 11, 2019 · Information Security

How to Detect and Recover From Linux Server Intrusions: Practical Steps

This guide outlines ten practical methods for Linux administrators to identify compromised machines on CentOS, including log inspection, checking /etc/passwd and /etc/shadow, analyzing login records, monitoring network traffic, and using lsof to recover deleted log files, with step‑by‑step commands and examples.

file recoveryintrusion-detectionlog analysis
0 likes · 7 min read
How to Detect and Recover From Linux Server Intrusions: Practical Steps
Alibaba Cloud Native
Alibaba Cloud Native
Feb 20, 2019 · Information Security

How to Leverage Kubernetes Audit Logs for Secure Monitoring and Analysis

This article explains the fundamentals of Kubernetes audit logs, their JSON format, recording stages and levels, and shows how to configure policies, analyze logs, and use Alibaba Cloud's integrated solution to create visual reports, custom alerts, and advanced queries for security monitoring.

KubernetesSecurity Monitoringaudit logs
0 likes · 13 min read
How to Leverage Kubernetes Audit Logs for Secure Monitoring and Analysis
Efficient Ops
Efficient Ops
Nov 18, 2018 · Operations

Master Server Log Analysis with Essential Linux Commands

This guide compiles a comprehensive set of Linux commands—using awk, grep, netstat, and more—to help you analyze web server logs, track traffic, identify top IPs, monitor connection states, and detect performance bottlenecks on an Alibaba Cloud ECS instance.

awklog analysisnetwork
0 likes · 15 min read
Master Server Log Analysis with Essential Linux Commands
MaGe Linux Operations
MaGe Linux Operations
Jul 15, 2018 · Operations

Mastering Web Log Analysis: Spotting Anomalies and Boosting Performance

This guide explains how to set up a Python‑based log‑analysis tool for web servers, defines key terminology, outlines installation requirements, describes its abstract‑based aggregation features, and demonstrates usage of the accompanying command‑line utility for request, IP, distribution, and detail analysis.

MongoDBlog analysisweb server
0 likes · 17 min read
Mastering Web Log Analysis: Spotting Anomalies and Boosting Performance
UCloud Tech
UCloud Tech
Apr 18, 2018 · Big Data

How Elasticsearch Powers Billion‑Record Log Analysis and Full‑Text Search

This article explains how Elasticsearch and the ELK stack address challenges of storing, securing, retrieving, and analyzing massive data volumes by providing distributed real‑time search, log collection, visualization, and even serving as a NoSQL alternative for large‑scale applications.

Elasticsearchbig dataelk
0 likes · 7 min read
How Elasticsearch Powers Billion‑Record Log Analysis and Full‑Text Search
MaGe Linux Operations
MaGe Linux Operations
Mar 23, 2018 · Operations

Build a High‑Performance Web Log Analyzer with Python and MongoDB

This article introduces a Python‑based log analysis tool for web servers that provides minute‑level aggregation, abstracted URI and argument patterns, and multi‑dimensional performance metrics, along with installation steps, core features, implementation details, usage commands, and deployment guidelines.

MongoDBPythonWeb Performance
0 likes · 17 min read
Build a High‑Performance Web Log Analyzer with Python and MongoDB
360 Zhihui Cloud Developer
360 Zhihui Cloud Developer
Jan 30, 2018 · Operations

Can You Predict Switch Failures Before They Happen? Inside PreFix’s ML Approach

This article reviews the PreFix system, which uses machine‑learning on datacenter switch logs to predict hardware failures ahead of time, detailing its design, feature extraction, random‑forest model, experimental validation across multiple switch models, and its broader applicability to disk failure prediction.

Random Forestdatacenter networkslog analysis
0 likes · 12 min read
Can You Predict Switch Failures Before They Happen? Inside PreFix’s ML Approach
MaGe Linux Operations
MaGe Linux Operations
Jan 12, 2018 · Information Security

How to Detect If Your UNIX Server Has Been Compromised: 11 Practical Checks

This guide walks through eleven hands‑on techniques for uncovering UNIX or Solaris intrusions, from inspecting password files and processes to verifying daemon configurations, network sockets, logs, core dumps, hidden files, file integrity, kernel modules, and the limits of manual detection versus IDS solutions.

Network Monitoringintrusion-detectionkernel integrity
0 likes · 14 min read
How to Detect If Your UNIX Server Has Been Compromised: 11 Practical Checks
MaGe Linux Operations
MaGe Linux Operations
Sep 11, 2017 · Big Data

How Big Data Can Revolutionize Operations Monitoring

This article explores applying big‑data thinking and platforms—such as Flume, Spark Streaming, and HBase—to operations monitoring, detailing data sources, metric categories, architecture design, implementation steps, and the benefits of a scalable, low‑code monitoring platform.

Spark Streamingarchitecturebig data
0 likes · 10 min read
How Big Data Can Revolutionize Operations Monitoring
Qunar Tech Salon
Qunar Tech Salon
Aug 7, 2017 · Backend Development

Design and Implementation of a Log‑Based Service Pre‑warming Component for Java Applications

To mitigate startup latency spikes in Java-based query services caused by class loading, JIT warm‑up, and lazy resource loading, the article presents a generic, low‑cost pre‑warming component that parses local Dubbo and HTTP logs, filters, samples, and replays traffic, detailing its design, implementation, and performance optimizations.

BackendDubboJava
0 likes · 9 min read
Design and Implementation of a Log‑Based Service Pre‑warming Component for Java Applications
dbaplus Community
dbaplus Community
Jul 30, 2017 · Information Security

Building an Enterprise‑Grade Server Security Audit System: Design, Tools, and Implementation

This article outlines the motivation, design principles, architecture, component choices, and step‑by‑step implementation of a comprehensive server security audit system, covering server information collection, log gathering, access control checks, local vulnerability detection, abnormal traffic analysis, and integration with ELK, Hadoop, and open‑source tools like Lynis and OSSEC.

LynisOSSECSecurity Audit
0 likes · 20 min read
Building an Enterprise‑Grade Server Security Audit System: Design, Tools, and Implementation
DevOps
DevOps
Apr 25, 2017 · Operations

Analyzing and Visualizing Docker Logs with the ELK Stack (Part Two)

This article explains how to analyze and visualize Docker container logs using the ELK stack, covering preparation, parsing tips, Kibana query techniques, and example visualizations to help monitor Dockerized environments effectively in production.

Kibanadockerelk
0 likes · 7 min read
Analyzing and Visualizing Docker Logs with the ELK Stack (Part Two)
Efficient Ops
Efficient Ops
Jan 4, 2017 · Information Security

How Deep Defense and Log Analysis Can Thwart Intrusions

This article explains Google’s BeyondCorp concept, the need for deep defense of internal and perimeter networks, and provides practical Linux scripts for monitoring processes, ports, command usage, system events, file changes, and SFTP activity to detect and mitigate host intrusions.

Deep DefenseLinux monitoringhost intrusion detection
0 likes · 10 min read
How Deep Defense and Log Analysis Can Thwart Intrusions
Alibaba Cloud Developer
Alibaba Cloud Developer
Dec 26, 2016 · Operations

How Alibaba’s SunFire Powers Real‑Time Monitoring for Billion‑Scale Transactions

Alibaba’s SunFire platform delivers massive‑scale, real‑time log collection, processing, and visualization for e‑commerce spikes like Double 11, using low‑overhead agents, asynchronous Map/Reduce pipelines, fault‑tolerant task scheduling, and shared inputs to ensure accurate, low‑latency monitoring across billions of transactions.

AlibabaReal-timelog analysis
0 likes · 18 min read
How Alibaba’s SunFire Powers Real‑Time Monitoring for Billion‑Scale Transactions
Efficient Ops
Efficient Ops
Nov 20, 2016 · Operations

Why Most Log‑Analysis Features Are Overrated and What Really Matters

The article critiques popular but unnecessary log‑analysis features—such as sub‑second alerts, endless pagination, flashy maps, full SQL support, bulk downloads, and live tail—arguing that focusing on practical alert content, efficient querying, and proper architecture yields far more value for IT operations.

DSLalertingdata visualization
0 likes · 10 min read
Why Most Log‑Analysis Features Are Overrated and What Really Matters
Qunar Tech Salon
Qunar Tech Salon
Oct 17, 2016 · Information Security

Design and Implementation of a Cloud‑Based Web Application Firewall at Ctrip

This article describes Ctrip's challenges with web security, evaluates hardware and commercial cloud WAF shortcomings, and presents a low‑cost, low‑risk cloud‑based WAF solution that leverages DNS redirection, closed‑loop rule management, Lua/Tengine deployment, supervised machine‑learning log analysis, and big‑data streaming for real‑time threat detection and mitigation.

WAFWeb Securitybig data
0 likes · 9 min read
Design and Implementation of a Cloud‑Based Web Application Firewall at Ctrip
ITPUB
ITPUB
Sep 29, 2016 · Operations

Build a Log Analysis Platform in 30 Minutes with ELK, Ansible, and Vagrant

This tutorial shows how to quickly set up a log analysis platform using the ELK stack, OpenResty, Ansible, and Vagrant, covering architecture, required tools, server provisioning, deployment commands, testing procedures, and next‑step enhancements for real‑world use.

ElasticsearchKibanaVagrant
0 likes · 10 min read
Build a Log Analysis Platform in 30 Minutes with ELK, Ansible, and Vagrant
Qunar Tech Salon
Qunar Tech Salon
Sep 18, 2016 · Operations

Analyzing Nginx Access Logs for Traffic, Performance, and Optimization

This article explains how to extract valuable performance and traffic insights from Nginx access logs using shell commands and awk, covering request volume, peak rates, bandwidth usage, slow‑query detection, URL normalization, and practical optimization recommendations for web operations.

Performance Monitoringawklog analysis
0 likes · 13 min read
Analyzing Nginx Access Logs for Traffic, Performance, and Optimization
dbaplus Community
dbaplus Community
Jul 5, 2016 · Operations

How to Transform Operations Monitoring with Big Data Thinking

This article explains how to apply big‑data concepts and platforms to operations monitoring, covering data sources, metric extraction from logs, architectural design with Flume, Spark Streaming and HBase, implementation steps, and the resulting benefits for scalability and rapid metric development.

Spark Streaminglog analysis
0 likes · 11 min read
How to Transform Operations Monitoring with Big Data Thinking
AI Cyberspace
AI Cyberspace
Jul 4, 2016 · Information Security

Master Linux Auditing: Essential Commands and Log Analysis Techniques

This guide explains essential Linux audit commands, log‑viewing techniques, user and process inspection methods, and additional checks such as file integrity, network monitoring, cron jobs, and backdoor detection, providing a comprehensive toolkit for system security and operations.

SecuritySystem Monitoringaudit
0 likes · 9 min read
Master Linux Auditing: Essential Commands and Log Analysis Techniques
Efficient Ops
Efficient Ops
Jun 19, 2016 · Operations

How Real‑Time Log Analysis Is Revolutionizing IT Operations

This article summarizes a 2016 Global Operations conference talk that explains the concept of IT Operations Analytics (ITOA), its four data sources, the evolution of log management from databases to real‑time search engines, and real‑world case studies demonstrating how fast, large‑scale log analysis improves monitoring, security, and business insight.

IT Operationsbig datalog analysis
0 likes · 25 min read
How Real‑Time Log Analysis Is Revolutionizing IT Operations
dbaplus Community
dbaplus Community
Mar 6, 2016 · Databases

Sudden Daily Accounting Lag: DBA Forensics Reveal Oracle RAC Log I/O Bottleneck

On February 10, 2016 a provincial accounting database experienced severe daily‑batch delays despite other applications running normally; a senior DBA collected alert logs, AWR snapshots, ASH dumps, and OSW metrics, uncovered log‑file‑sync and redo‑IO degradation, increased rollbacks, and a faulty SAN link, pinpointing the root cause.

AWRDBAOracle
0 likes · 8 min read
Sudden Daily Accounting Lag: DBA Forensics Reveal Oracle RAC Log I/O Bottleneck
21CTO
21CTO
Jan 9, 2016 · Big Data

How We Scaled Real‑Time Log Analysis to 2 TB Daily with ELK

This article shares the author's practical experience building a real‑time log analysis platform at Sina, covering service scope, ELK architecture, performance optimizations, usability improvements, new features, common pitfalls, and a concise Q&A for engineers handling massive log streams.

ElasticsearchKafkaReal-time
0 likes · 12 min read
How We Scaled Real‑Time Log Analysis to 2 TB Daily with ELK
ITPUB
ITPUB
Nov 16, 2015 · Information Security

5 Hidden Signs Your Web Application Is Compromised and How to Respond

The article outlines five subtle indicators of a web application breach—abnormal behavior, irregular logs, unexpected processes or users, file modifications, and warning messages—while offering practical monitoring and remediation steps to help security teams detect and mitigate attacks early.

Web Securityapplication monitoringincident response
0 likes · 7 min read
5 Hidden Signs Your Web Application Is Compromised and How to Respond
Qunar Tech Salon
Qunar Tech Salon
Oct 31, 2014 · Operations

Simple Testing Can Prevent Most Critical Failures: Findings from an Analysis of Five Open‑Source Distributed Systems

A recent study of five major open‑source distributed systems reveals that most failures can be triggered and reproduced with simple, multi‑event tests, highlighting the importance of systematic testing, deterministic error handling, and concise logging for reliable system operation.

Distributed Systemsbug analysislog analysis
0 likes · 6 min read
Simple Testing Can Prevent Most Critical Failures: Findings from an Analysis of Five Open‑Source Distributed Systems