Tagged articles
production debugging
32 articles · Page 1 of 1
Go 1.27 introduces a goroutine leak profiler that uses a modified garbage collector to identify permanently blocked goroutines on channels and sync primitives in running programs, including production, with minimal overhead and near-zero false positives, demonstrated through real-world examples from CockroachDB, etcd, Kubernetes, and Moby.
Garbage CollectionGo 1.27channel
0 likes · 29 min read

This article explores Arthas 4, a Java diagnostic tool that attaches to running JVMs without restart, detailing its core capabilities (thread, method, class inspection, hot-swapping, profiling), new features in version 4 (JDK 25 support, wall-clock flame graphs, MCP Server for AI-driven command execution), practical usage scenarios with commands, pros/cons, and ideal use cases.
AI-assisted debuggingArthasJDK 25
0 likes · 20 min read

The author shares five practical engineering challenges — tool timeout handling, RAG retrieval debugging, long-context memory management, infinite loop prevention, and workflow recovery — that reveal whether Agent developers have real production experience beyond buzzwords like RAG and tool calling.
AI AgentsIdempotencyLangGraph
0 likes · 11 min read

The author shares a real incident where AI-generated code caused a production issue, demonstrating that while AI accelerates coding, debugging speed depends on runtime logs; the article outlines five key scenarios requiring logging—data filtering, fallbacks, precondition failures, empty queries, and cross-system calls—to give AI the context needed for rapid root-cause analysis.
AI-assisted codingengineering ruleslogging best practices
0 likes · 11 min read


java1234Oct 28, 2026 · Backend Development
This article explores Arthas 4, Alibaba's open-source Java diagnostic tool, covering its core commands, troubleshooting workflow, new features including JDK 8-25 support, improved flame graphs with wall-clock profiling, Metaspace analysis by classloader, and experimental MCP integration for AI-assisted debugging, with three practical command examples for CPU analysis, method tracing, and memory profiling.
ArthasJDK 25JVM troubleshooting
0 likes · 10 min read


ITPUBOct 24, 2026 · Operations
Traditional Prometheus monitoring missed micro-bursts, TCP zero-windows, fsync storms, conntrack exhaustion, and startup file traversal — eBPF kernel-level tracing revealed all five root causes in a production Kubernetes cluster.
KubernetesPrometheusTCP
0 likes · 17 min read

A systematic guide to diagnosing 'can't connect' failures in production, covering DNS resolution, layer 3 routing, firewall rules, and TCP connection states with practical Linux commands for RHEL 8 and Kubernetes environments.
DNSKubernetesLinux commands
0 likes · 28 min read

Arthas 4 introduces an experimental MCP Server module that wraps its 29 diagnostic commands as AI-callable tools via JSON-RPC 2.0 over StreamableHTTP, enabling AI-assisted JVM troubleshooting (e.g., CPU 98% analysis) while preserving bytecode instrumentation; configuration, tool categories, security caveats, and a real-world debugging walkthrough are detailed.
AI-assisted debuggingArthasJVM diagnostics
0 likes · 12 min read

This article details systematic troubleshooting for 900% CPU spikes in MySQL and Java processes, covering top/jstack diagnostics, show processlist analysis, index optimization, cache integration, and fixing busy-wait loops with BlockingQueue.take(), illustrated through real production case studies.
Database IndexingJava thread analysisMySQL performance tuning
0 likes · 12 min read

An engineer details a week-long investigation into random microservice disappearances from Nacos in a Spring Cloud Alibaba cluster, systematically ruling out memory, CPU, disk, network, Nacos server/client issues, and JVM problems before discovering a Linux kernel bug causing JVM pauses, resolved by kernel upgrade.
ArthasJVMLinux kernel
0 likes · 9 min read


liandkSep 25, 2026 · Backend Development
This comprehensive guide covers the five critical MQ production failures — message loss, duplicate consumption, massive backlog, consumer hangs, and dead letter queue blocking — with root cause analysis, emergency mitigation steps, and long-term architectural fixes for RocketMQ, Kafka, and RabbitMQ.
Distributed SystemsKafkaMQ
0 likes · 14 min read


ITPUBSep 24, 2026 · Backend Development
Ctrip's JDK 25 upgrade revealed a silent data corruption bug in G1GC's Optional Evacuation phase, where pinned objects used by JNI critical sections (e.g., zstd-jni) were incorrectly moved, corrupting Parquet/ORC files without write-time errors; root cause traced to commit 86cec4ea and fixed via backport JDK-8377811.
G1GCJDK 25JNI
0 likes · 24 min read

The article explains livelock using a RabbitMQ incident where unacknowledged messages cause endless re-delivery, and describes two production fixes: immediate try-catch with ACK to stop the loop, then bug fix; and a configurable "empty consumption" switch to discard messages when replay is possible.
ConcurrencyMessage QueueRabbitMQ
0 likes · 6 min read


liandkSep 11, 2026 · Backend Development
This guide teaches how to read Java GC logs field by field, distinguish Minor/Major/Full GC, apply production-ready criteria to judge normal vs abnormal GC, and resolve four common GC anomaly scenarios with root-cause analysis and solutions.
GCGC LogsJVM
0 likes · 15 min read


liandkSep 9, 2026 · Backend Development
This guide demonstrates how to use Arthas, Alibaba's open-source Java diagnostic tool, to troubleshoot production issues without downtime—covering installation, core commands (dashboard, trace, watch, stack, logger, redefine), three real-world case studies, and critical production safety rules.
ArthasHot ReloadJava
0 likes · 12 min read

This article teaches practical Linux log analysis commands (tail, less, grep, sed, awk) with real-world scenarios like monitoring service startup, tracing orders, extracting error context, searching across rolled logs, counting exceptions, filtering noise, slicing time windows, and analyzing Nginx logs for top IPs and slow endpoints.
LinuxNginx logsawk
0 likes · 10 min read

A team troubleshoots random microservice disappearances from Nacos in a Spring Cloud Alibaba cluster, ruling out memory, CPU, disk, network, and Nacos client issues before discovering a Linux kernel bug causing JVM pauses, fixed by kernel upgrade.
ArthasJVMLinux kernel
0 likes · 11 min read


liandkSep 7, 2026 · Backend Development
This article contrasts junior developers' trial-and-error debugging with senior engineers' structured four-step method — confirm symptoms, layer-by-layer isolation, evidence-based root-cause analysis, and closed-loop remediation — to cut production incident resolution from hours to minutes.
JVMJavaincident response
0 likes · 8 min read

When a production Java service throws a NullPointerException at 2 AM, this article shows how the Arthas diagnostic tool can attach to the running JVM, inspect threads, monitor method parameters, and pinpoint the faulty null value without restarting the service, all within a few minutes.
ArthasJVMJava
0 likes · 12 min read

This guide teaches practical log troubleshooting by correlating browser network requests (via F12) with server logs using tail -f for real-time tracking and grep with timestamps for post-hoc analysis, explaining how to identify the correct service from URL paths and distinguish service failures from business logic errors.
F12 developer toolsgrep commandlog analysis
0 likes · 12 min read

The article details ten production‑grade pitfalls encountered when using LangGraph—ranging from misusing thread IDs and unbounded state growth to uncaught tool errors, infinite loops, concurrency conflicts, subgraph field mismatches, HITL timeouts, and misconfigured LangSmith tracing—each illustrated with concrete code, root‑cause analysis, and concrete remediation steps.
AI AgentsLLMLangGraph
0 likes · 14 min read

The article walks through replacing MyBatis 3.5.0 with MyBatis‑Plus 3.1.1 in a legacy Java project, uncovers version‑specific LocalDateTime conversion failures, shows how upgrading mysql‑connector‑java resolves them, and reflects on the broader impact of component upgrades on production stability.
Connector UpgradeJavaLocalDateTime
0 likes · 8 min read

This guide explains how to use Alibaba's open‑source Java diagnostic tool Arthas to non‑intrusively monitor, locate, and resolve CPU performance bottlenecks in production Java applications, covering installation, key commands, a step‑by‑step troubleshooting workflow, and a real‑world case study.
ArthasCPU profilingFlame Graph
0 likes · 16 min read

Go 1.25 introduces Trace Flight Recorder, a lightweight circular‑buffer tracing tool that lets developers capture recent execution data in production with minimal overhead, and the article walks through its concepts, configuration, code demos, analysis workflow, and practical use cases.
Flight RecorderGoPerformance Monitoring
0 likes · 12 min read

This article introduces a SpringBoot online debugging injector that lets backend developers add, adjust, and remove fine‑grained debug rules at runtime, eliminating midnight alarm calls, costly redeployments, and performance bottlenecks while keeping production services safe and uninterrupted.
ByteBuddyJava AgentOnline Debugging
0 likes · 18 min read

This article examines various intermittent problems that surface in production environments—such as concurrency bugs, cache inconsistencies, dirty data, boundary‑value failures, hardware limits, and improper shutdown—provides categorized scenarios, concrete code examples, and practical lessons for preventing and troubleshooting these elusive issues.
intermittent bugsproduction debugging
0 likes · 12 min read

Production teams often face intermittent bugs that slip through local and test environments, typically caused by concurrency issues, cache inconsistencies, mutable shared templates, improper thread‑local cleanup, unsynchronized async tasks, race conditions, and resource failures, so writing thread‑safe code, simulating real traffic, logging clearly, and ensuring graceful shutdowns are essential for prevention.
ConcurrencyThread Safetyintermittent bugs
0 likes · 14 min read


政采云技术Dec 23, 2021 · Frontend Development
This comprehensive guide explores essential Chrome DevTools techniques for debugging frontend applications in production environments, covering methods to distinguish frontend and backend errors, efficiently locate problematic code using global search, debug minified JavaScript with local source maps, and apply real-time code modifications through local overrides.
Chrome DevToolsFrontend DebuggingJavaScript minification
0 likes · 9 min read

The article reveals that while DevOps has exploded with trends like Hybrid Deployments, DataOps, and GitOps, the overlooked but critical shift toward non‑invasive production debugging—providing code‑level observability without disrupting services—will become essential for modern DevOps teams.
APMDevOpsinstrumentation
0 likes · 14 min read

The article explores the rising DevOps trend of non‑invasive production debugging, explaining its advantages over traditional log‑based methods, detailing instrumentation techniques, showing code examples, and highlighting its impact on key DevOps metrics and industry adoption.
APMDevOpsNon-invasive
0 likes · 13 min read

A senior developer recounts a high‑pressure midnight migration from an aging monolithic platform to a new micro‑service system, describing the technical challenges, ad‑hoc multithreading solutions, and the crucial problem‑solving mindset required to keep millions of transactions running smoothly.
Multithreadingbackend-migrationproblem-solving
0 likes · 15 min read


Aotu LabFeb 25, 2016 · Backend Development
This guide explains practical techniques for diagnosing Node.js production issues, covering request‑latency analysis, CPU profiling with perf and FlameGraph, crash investigation via Core Dumps and mdb_v8, and memory‑leak detection using gcore and mdb_v8 diff tools.
CPU FlameGraphMemory LeakNode.js
0 likes · 11 min read
