Tagged articles
log parsing
14 articles · Page 1 of 1
The article outlines three core challenges—semantic gaps, poor generalization, and industrial usability—in operation intelligence and presents three academic breakthroughs—AutoDA‑Timeseries, SemanticLog, and LogBase—that together advance AI‑powered monitoring, log parsing, and large‑scale benchmarking for smarter, more efficient cloud operations.
AI OpsAutoDALogBase
0 likes · 9 min read

This article presents ten essential SRE interview questions covering process priority, shell variable persistence, TTD/TTR metrics, system design for LinkedIn and Twitter, load‑balancing strategies, conflict handling, REST API usage, and log‑parsing code, each with detailed explanations and practical examples.
InterviewLinux commandsSRE
0 likes · 9 min read

ByteBrain-LogParser is a cloud‑native log‑parsing framework that transforms unstructured logs into dynamic templates with real‑time precision control, delivering parsing speeds up to two orders of magnitude faster than state‑of‑the‑art methods while maintaining near‑SOTA accuracy and low storage overhead.
Efficiencycloud serviceshierarchical clustering
0 likes · 27 min read

This guide explains Logstash’s Grok filter plugin, detailing how its 120 built‑in and custom patterns transform unstructured logs—such as Apache, MySQL, or HiveServer2—into structured fields through named regex captures, supporting type conversion, cleaning, debugging, and efficient ETL for analysis and monitoring.
ETLGrok filterLogstash
0 likes · 8 min read

This article explains how to implement online traffic replay for Python automated testing by parsing logs, storing request data in a local MySQL database, analyzing user information with data‑analysis libraries, and locally persisting URL, method, headers, and body details using JSON files, complete with sample code.
MySQLPythonTraffic Replay
0 likes · 5 min read

This article walks through a Python interview problem that extracts level‑up events from a log file, demonstrating step‑by‑step data cleaning, JSON parsing, and aggregation with pandas, and provides the complete, ready‑to‑run code plus visual explanations.
Code TutorialPandasinterview question
0 likes · 5 min read

This article explains how Python can automate common operations tasks—remote command execution, log parsing, system monitoring with alerts, bulk software deployment, and backup/restore—providing code examples for each and highlighting additional tools that help sysadmins improve efficiency and reduce errors.
PythonSysadmin Scriptsbackup
0 likes · 9 min read

This tutorial explains how to extract logs from a 16 GB file in about 25 seconds by reading the file in chunks, reusing buffers with sync.Pool, and processing those chunks concurrently with Go goroutines, avoiding full‑memory loads or slow line‑by‑line scans.
ConcurrencyFile ProcessingGo
0 likes · 9 min read

This guide demonstrates how to configure Nginx log formatting, write Grok patterns, and set up Logstash to ingest Nginx access logs into Elasticsearch for visualization in Kibana, covering step‑by‑step configuration and regex extraction techniques.
ElasticsearchGrokKibana
0 likes · 3 min read

This article explains why standardized log parsing is crucial for security analytics, outlines key parsing concepts, compares pre‑ and post‑parsing approaches, discusses flexible custom parsing methods, and offers practical guidance to improve accuracy and efficiency in large‑scale security environments.
SOCcustom parsinginformation security
0 likes · 12 min read

This guide shows how to configure Filebeat and Logstash to ingest, parse, and index multi‑line MySQL slow query logs in Elasticsearch, covering filebeat setup, Logstash input, grok filter, and output configurations.
LogstashMySQLelk
0 likes · 4 min read

The article describes a log‑parsing feature for Youzan’s big‑data offline platform that captures runtime logs from Hive, Spark, DataX, MapReduce and HBase jobs, categorizes scheduling types, extracts metrics such as read/write bytes, shuffle volume and GC time, and processes them in real time via a Filebeat‑Logstash‑Kafka‑Spark‑Streaming pipeline storing results in Redis for monitoring, optimization and resource‑usage ranking.
Resource MonitoringYARNbig data
0 likes · 7 min read

Xtrabackup is an open-source hot backup tool for InnoDB and XtraDB databases, offering non-blocking backups with features like fast backup speeds, reliable physical backups, and efficient disk space usage. The recovery process involves complex log parsing and page flushing mechanisms, which can be optimized to improve performance, especially for large datasets.
InnoDBPage FlushingXtraBackup
0 likes · 16 min read

This tutorial explains how to use Logstash's Grok filter to parse log events, covering basic syntax, custom patterns, built‑in methods like add_field and add_tag, and provides practical configuration examples with visual results.
GrokKibanaLogstash
0 likes · 5 min read
