Tagged articles

incident postmortem

5 articles · Page 1 of 1

Jun 21, 2026 · Operations

10 AM System Auto‑Paid ¥600K: A Full Post‑mortem of a Commission Settlement Incident

At 10 am a monitoring alarm revealed that the day's commission settlement jumped to ¥600 K—seven times the usual amount—prompting an immediate shutdown of withdrawals, a rapid root‑cause investigation that uncovered a missing else‑if condition, and a nine‑hour data rollback followed by the launch of a real‑time business monitoring platform.

OperationsRoot Cause Analysisbusiness monitoring platform

0 likes · 9 min read

10 AM System Auto‑Paid ¥600K: A Full Post‑mortem of a Commission Settlement Incident

IoT Full-Stack Technology

May 27, 2026 · Information Security

How Claude Deleted an Entire Production Database in 9 Seconds – A Postmortem

In a shocking nine‑second incident, PocketOS’s AI‑driven Cursor using Claude Opus 4.6 wiped its production database and backup on Railway, exposing over‑privileged tokens, missing confirmation steps, and prompting a broader industry warning about AI agents and platform governance.

AI agentsClaudeDatabase Security

0 likes · 10 min read

How Claude Deleted an Entire Production Database in 9 Seconds – A Postmortem

Tech Architecture Stories

Sep 14, 2024 · Operations

Why Most Incident Postmortems Miss the Mark and How to Fix Them

This article reveals three common pitfalls in daily incident postmortems—overlooking minor failures, confusing root causes with triggers, and weak improvement actions—and offers practical steps like the 5 Whys method and essential corrective measures to truly reduce online outages.

Root Cause AnalysisSREcontinuous improvement

0 likes · 5 min read

Why Most Incident Postmortems Miss the Mark and How to Fix Them

Didi Tech

Nov 23, 2023 · Operations

Root Cause Analysis of Java Process Termination Caused by Linux OOM Killer Triggered by Vim Opening a 37 GB Log File

The Java service crashed when the Linux OOM killer terminated its process after a developer opened a 37 GB log file with Vim, which loaded the entire file into the container’s 8 GB memory, triggering a port alarm and prompting investigation and recommendations to use streaming tools instead of Vim.

LinuxOOM killerVim

0 likes · 8 min read

Root Cause Analysis of Java Process Termination Caused by Linux OOM Killer Triggered by Vim Opening a 37 GB Log File

Xiaohe Frontend Team

Nov 10, 2022 · Operations

What Went Wrong with Our Multi‑User Live Audio Feature? A Post‑Mortem and Lessons Learned

This post‑mortem reviews a chaotic multi‑person live‑audio incident, detailing its background, symptoms, timeline, root causes, and the improvement plan, offering practical insights for better release planning, gray‑release strategies, and risk awareness in software operations.

Software Operationsgray releasehot update

0 likes · 7 min read

What Went Wrong with Our Multi‑User Live Audio Feature? A Post‑Mortem and Lessons Learned