Tagged articles
fault injection
80 articles · Page 1 of 1
This article details how to build a proactive fault prevention system for 10M QPS architectures by modeling risk, automating change verification, observing leading signals, continuously validating defenses, and layering independent safeguards—moving beyond reactive incident response to prevent failures before they occur.
SLOcanary deploymentcapacity planning
0 likes · 36 min read

Alibaba Cloud details its methodology for constructing and maintaining high-quality evaluation datasets for the STAROps AIOps agent, covering fault injection, signal capture, evidence extraction, quality checks, environment construction, and continuous iteration to ensure reliable root cause analysis assessments.
AIOpsAgent EvaluationRoot Cause Analysis
0 likes · 42 min read

This article details a systematic framework for turning post-mortem action items into verified risk reductions, covering eight required fields, single-owner accountability, a five-state tracking machine, risk-based prioritization, layered governance rhythms, three-evidence acceptance criteria, and cross-team dependency management for 10M QPS systems.
acceptance criteriaaction itemsclosed-loop improvement
0 likes · 32 min read

This article details how to build a production-grade order service using Kratos v2, MySQL, Kafka, and Kubernetes, covering idempotency keys, outbox pattern, inventory reservation, state machines, context/timeouts, middleware, observability, Kubernetes probes, capacity planning for 8000 QPS, and automated fault-injection tests.
IdempotencyInventory ReservationKratos
0 likes · 63 min read

This article presents a comprehensive Go error handling framework that separates domain causes, protocol results, internal causes, operation context, and execution decisions, demonstrating layered error conversion, deterministic boundary classification, safe HTTP/gRPC responses, cross-service error propagation, observability integration, Kafka offset management, and fault injection validation for production microservices.
GoKafkaerror handling
0 likes · 32 min read

The article explains why a tool's success response doesn't guarantee an Agent task is done, detailing three verification layers (call, execution, task), upfront acceptance criteria, timeout recovery via state reconciliation, and evaluation metrics that separate run completion from true task acceptance.
AI agentsAcceptance TestingAgent Evaluation
0 likes · 18 min read

This article defines software reliability per ISO/IEC 25010, distinguishes it from availability and stability, and details five operational concerns — correct user-visible results, change management, blast radius, detection/recovery speed, and failure semantics — with concrete distributed-systems patterns like idempotency, fault domains, burn-rate alerting, and fault injection.
CAP theoremError BudgetIdempotency
0 likes · 34 min read

This article explains why retry alone is insufficient for fault tolerance, detailing how to classify failures via fault models, apply appropriate mechanisms like timeouts and circuit breakers, design recovery paths targeting state convergence, define RTO/RPO for disaster recovery, and validate all assumptions through fault injection drills.
Circuit BreakerIdempotencyRPO
0 likes · 23 min read

This article exposes common chaos engineering misconceptions, defines five forbidden zones for production experiments, and provides a four-stage progressive approach with strict blast-radius controls and a standardized SOP for ordinary enterprises to safely validate system resilience without causing real incidents.
SOParchitectureblast radius
0 likes · 19 min read

This article explains why traditional capacity planning fails under real faults, detailing how to build continuous fault injection practices with hypothesis-driven experiments, blast radius control, automated stop conditions, and fault capacity maps to transform theoretical headroom into verified effective throughput at 10M QPS scale.
blast radiuscapacity mapcapacity planning
0 likes · 32 min read

The article introduces AISHPerf, the first open‑source benchmark for AI‑infra operations agents built on nearly a hundred‑billion real‑world ops records, detailing its data pipeline, multi‑layer coverage, evaluation metrics, experimental results that show current models lag behind human experts, and future plans to expand and refine the benchmark.
AI OpsBenchmarkEvaluation Metrics
0 likes · 16 min read

The article examines how adversarial testing—beyond AI red‑team attacks—has become a system‑level quality safeguard, illustrating a real‑world financial app breach, a three‑layer testing framework, engineering maturity steps, and the evolving role of test engineers in resilient software development.
AI riskCI/CDadversarial testing
0 likes · 8 min read

The article explains how adversarial testing shifts from a user‑centric to an attacker‑centric paradigm, illustrates real‑world cases in finance, autonomous driving and AI, outlines perturbation layers, evaluation metrics, automation pipelines, and three counter‑intuitive principles for effective deployment, highlighting its advantages over conventional testing.
AI safetySoftware RobustnessTesting Methodology
0 likes · 8 min read

This article explains how chaos engineering deliberately injects failures to reveal hidden weaknesses, helping organizations test and improve infrastructure resilience, handle traffic spikes, recover from disasters, and maintain continuous service in today’s always‑on digital environment.
chaos engineeringfault injectionhypothesis driven
0 likes · 7 min read

Chaos engineering, a scientific method for improving system resilience, is explored through an overview of leading tools such as Gremlin, ChaosBlade, Chaos Mesh, Chaos Toolkit, and ChaosMeta, alongside core concepts, real-world case studies, common misconceptions, and the practical value of controlled fault injection in distributed systems.
chaos engineeringdistributed systemsfault injection
0 likes · 12 min read

Chaos engineering is a discipline that deliberately injects faults into distributed systems to test and improve resilience, tracing its evolution from Netflix's Chaos Monkey to modern platforms, outlining its operational workflow, benefits, and core principles for reliable system design.
OperationsSREchaos engineering
0 likes · 9 min read

Understanding the three HTTP timeout types—connect, write, and read—helps engineers pinpoint failures, while detailed examples of causes and observable symptoms guide troubleshooting, and step-by-step Chaos Mesh simulations demonstrate how to inject and monitor these faults to validate system resilience.
BackendHTTPTimeout
0 likes · 17 min read

This article explains how Sentinel, an open‑source flow‑control component from Alibaba, provides fine‑grained rate limiting, circuit breaking, and system protection for microservices, detailing its core mechanisms, configuration options, and practical usage in performance and fault testing.
Flow Controlcircuit breakingfault injection
0 likes · 14 min read

This article explains chaos engineering—its definition, core principles, experimental workflow, tool selection, AI‑driven enhancements, and practical case studies—providing a comprehensive guide for building resilient distributed systems across backend, cloud‑native, mobile, and AI‑enabled environments.
AI IntegrationOperationschaos engineering
0 likes · 26 min read

The article explains how performance testing measures system efficiency under load while fault testing validates resilience under abnormal conditions, highlighting their shared goals, differences, overlapping toolchains, and how their combined use drives architecture optimization and improves service level agreements in modern complex software systems.
OperationsResiliencefault injection
0 likes · 14 min read

Bilibili’s engineering team built a scenario‑metadata and one‑click fault‑drill platform, implemented multi‑tier degradation, dynamic capacity planning, and extensive automated fault‑injection testing to guarantee zero‑severity incidents during the high‑traffic 2025 Spring Festival Gala live stream.
Operationsfault injectionhigh concurrency
0 likes · 16 min read

Fault injection testing deliberately introduces failures into a system to assess its resilience, helping identify weak points, improve retry and timeout mechanisms, and ensure robust operation across software, protocol, and infrastructure layers, with practical guidance on processes, tools, and Kubernetes-specific practices.
KubernetesOperationschaos engineering
0 likes · 8 min read

This article demonstrates how to use Byteman’s DO execution module on the Chaos Mesh platform to invoke static or instance methods of external Java classes without modifying the original code, covering reflection, ClassLoader tricks, and a complete BTM rule example.
BytemanChaos MeshClassLoader
0 likes · 7 min read

This guide walks you through downloading Byteman, setting up BYTEMAN_HOME, using Ant or Maven for integration, building from source, configuring the Java agent with detailed options, and leveraging tutorials for effective fault‑injection testing in Java applications.
AntBytemanJava
0 likes · 8 min read

In today's always‑on digital era, this article explains chaos engineering concepts, step‑by‑step experimental methods, best‑practice guidelines, and a comparison of leading fault‑injection tools to help organizations proactively strengthen system resilience and reduce downtime risk.
DevOpschaos engineeringcloud-native
0 likes · 11 min read

Byteman is a powerful Java bytecode manipulation tool that lets developers inject custom code at runtime without recompiling, using an event‑condition‑action rule language to trace, modify execution flow, coordinate threads, and collect statistics, with detailed examples of rule syntax, binding, and built‑in actions.
Javabytecodefault injection
0 likes · 12 min read

Byteman is a dynamic Java fault‑injection tool that lets developers simulate network delays, service crashes, and resource exhaustion without altering source code, offering seamless integration with JUnit/TestNG, detailed rule definitions, and convenient shell scripts for installing, submitting, and removing fault‑injection rules.
BytemanJVMJava
0 likes · 12 min read


DevOpsAug 22, 2024 · Operations
This article explains why service stability is critical, outlines the importance and key factors of synthetic monitoring, provides practical guidelines for implementing it, and then describes fault‑drill concepts, benefits, processes, and common cloud‑native tools to proactively discover and mitigate failures in micro‑service environments.
OperationsSynthetic Monitoringfault injection
0 likes · 11 min read

This article presents a detailed experimental study of OceanBase's Arbitration Service in a 2F1A (two full‑function replicas plus one arbitration node) configuration, examining how the system behaves when one or both full‑function replicas fail, how log‑stream degradation and permanent offline mechanisms work, and how normal service is restored after node recovery.
Arbitration ServiceDistributed DatabaseHigh Availability
0 likes · 17 min read

The article outlines a three‑stage evolution of operations—from rapid incident response to proactive fault‑injection—while offering practical guidance on improving availability, visualizing changes, and aligning technical metrics with business value to elevate the role of operations engineers.
SREavailabilityfault injection
0 likes · 7 min read

This article describes how WeChat Pay applied chaos engineering to improve system reliability, detailing the business scenario, challenges of controlling fault injection radius, practical solutions, risk assessment, automation, and the resulting business and tool achievements.
High AvailabilityOperationsWeChat Pay
0 likes · 18 min read

To improve the ultra‑high availability of WeChat Pay, the team introduced chaos engineering using multi‑partition isolation, controlled blast radius, automated fault injection, and systematic risk discovery, detailing the design, execution, automation, and results of this reliability‑focused initiative.
WeChat Paychaos engineeringfault injection
0 likes · 18 min read

WeChat Pay’s team adopted Netflix‑style chaos engineering, building an automated, YAML‑driven fault‑injection platform that isolates experiments in multi‑zone partitions, enabling over 500 safe experiments in 2021‑2022, uncovering critical bugs across core services while maintaining five‑nine availability and zero production incidents.
High AvailabilityWeChat Payautomation
0 likes · 18 min read

Meituan’s Technical Salon #77 presented a client‑side robustness testing framework that mutates API responses using semantic rules, injects them via a proxy, and detects crashes or hangs through static code scans and dynamic monitoring, employing array‑deduplication techniques to cut test volume while maintaining coverage, now deployed in Meituan and Youxuan apps.
Robustnessclient-side qualitydata mutation
0 likes · 15 min read

For the 13th League of Legends World Championship live stream on Bilibili, a comprehensive technical‑assurance framework—covering pre‑event traffic buildup, in‑event experience, and post‑event replay—mapped over 60 business functions, applied a traffic‑estimation model, executed fault‑injection drills, load tests, strict SOPs and change control, and real‑time monitoring, enabling 120 million viewers and a peak of 460 million concurrent users.
OperationsTraffic Engineeringfault injection
0 likes · 19 min read

ChaosMeta V0.6.0 introduces DNS and log injection capabilities, lossless fault injection concepts, automated experiment orchestration with atomic tasks, and a roadmap for multi‑cloud support and advanced metrics, aiming to solve the last‑mile challenge of continuous automated chaos experiments in production environments.
automated experimentschaos engineeringfault injection
0 likes · 9 min read

Facing growing microservice complexity, HuoLala designed a comprehensive fault‑drill system—covering management, tooling, and operations—to simulate failures, control blast radius, automate scenarios, and continuously improve resilience, ultimately reducing downtime and enhancing system stability across more than ten business units.
Operationsautomationchaos engineering
0 likes · 12 min read

The article details the design and deployment of a Java‑focused fault‑injection platform that uses Attach agents and JVM‑Sandbox to inject controllable pod‑ and request‑level faults—such as latency, exceptions, and return‑value errors—through dynamic templates, enabling fine‑grained, production‑safe chaos testing for e‑commerce services.
Java applicationJava developmentagent-based
0 likes · 15 min read


DevOpsMay 12, 2023 · Operations
This article examines how Netflix has progressively refined its chaos engineering practices—from the early Chaos Monkey tool to the sophisticated Chaos Automation Platform (ChAP)—to improve system resilience, automate experiments, and safely validate changes in large‑scale microservice environments.
Netflixchaos engineeringfault injection
0 likes · 26 min read

This article offers a comprehensive overview of chaos engineering, explaining its definition, why it is needed, the value it brings, a detailed step‑by‑step practice workflow—including preparation, execution, recovery and review phases—typical drill scenarios, key assessment metrics, and risk‑control measures to improve system reliability and high‑availability.
chaos engineeringfault injectionrisk-management
0 likes · 11 min read

This article explains the origins and principles of chaos engineering, illustrates how fault‑injection scenarios expose system weaknesses, outlines step‑by‑step implementation—from tool selection and metric definition to execution and post‑mortem—and highlights its role in achieving high‑availability service level agreements.
DevOpsOperationschaos engineering
0 likes · 10 min read

This article explains ByteDance’s end‑to‑end chaos engineering practice for cloud‑native environments, covering its background, principles, comparison with traditional testing, the evolution of its internal platforms, and a detailed look at the Application Resilience Enhancement Service (ARES) and its core features.
KubernetesResiliencechaos engineering
0 likes · 17 min read

Chaos Engineering and Fault Injection System Design combine steady-state hypotheses, controlled blast-radius experiments, and a lightweight interceptor layer using gRPC and protobuf to inject and report faults in micro-service architectures, enabling continuous testing, rapid MTTR reduction, and resilient services through automated, real-time experimentation and analysis.
Gofault injectiongRPC
0 likes · 15 min read

Chaos Mesh, a CNCF‑hosted cloud‑native chaos engineering platform, orchestrates fault injection experiments in Kubernetes through components like the Chaos Operator and Dashboard, supporting various CRD types such as DNSChaos, PodChaos, and NetworkChaos to simulate failures ranging from pod kills to network partitions.
Chaos Meshfault injectionreliability testing
0 likes · 7 min read

Chaos engineering, a discipline for experimenting on distributed systems, helps teams identify hidden weaknesses, improve high‑availability, and build confidence in production by defining stable states, injecting realistic failures, and measuring impact through observability metrics, with practical steps, tool choices, maturity stages, and evaluation methods.
Operationschaos engineeringdistributed systems
0 likes · 11 min read


ITPUBJun 27, 2022 · Big Data
This article details Kuaishou's real‑time data warehouse architecture, the business challenges of massive traffic and diverse requirements, and the forward‑ and reverse‑assurance strategies—including lifecycle standards, monitoring, fault‑injection testing, and a Spring Festival case study—that together ensure high stability, low latency, and sub‑0.5% accuracy for billion‑scale streaming workloads.
Flink streamingKuaishouSLA monitoring
0 likes · 22 min read

This article details Qunar Travel's mature chaos engineering platform built on chaosblade, covering value analysis, system architecture, shutdown and dependency drills, automated closed‑loop testing, attack‑defense exercises, and the measurable reliability improvements achieved across thousands of services.
Operationschaos engineeringdistributed systems
0 likes · 18 min read

Peng Liangyou describes how Bilibili’s large‑scale distributed KV storage adopts Netflix‑style chaos engineering—defining steady‑state hypotheses, replicating production environments, injecting CPU, memory, network and replica faults via automated “monkey” experiments, monitoring latency and durability with Prometheus/Grafana, and over 1.5 years preventing critical incidents while cutting testing costs and enabling incremental, standards‑based reliability improvements.
BilibiliKV storechaos engineering
0 likes · 15 min read

This article outlines Ant Group's six‑year journey in chaos engineering, describing its three generational evolutions, business‑oriented fault injection, risk‑mining, full‑lifecycle coverage, massive scale, root‑data protection, core technologies such as Awatch, simulation environments, and plans for intelligent, open‑source future development.
Ant GroupAwatchRisk Mining
0 likes · 23 min read

This article explains how cloud‑native teams can adopt chaos engineering—defining its concepts, outlining its unique characteristics, and detailing a four‑stage implementation process from manual drills to production‑level raids, with practical steps, environment setups, and real‑world results.
KubernetesOperationschaos engineering
0 likes · 14 min read

Chaos Mesh is an open‑source cloud‑native chaos engineering platform that lets you experiment with fault injection across Kubernetes environments, offering visual dashboards, extensive fault types, and step‑by‑step installation and experiment creation guides to help teams uncover system weaknesses and improve resilience.
Chaos MeshKuberneteschaos engineering
0 likes · 12 min read

This article explains how to deploy the ChaosBlade Operator on a KubeSphere cluster, define and run various chaos experiments—such as CPU overload, network latency, packet loss, and process kill/stop—against RadonDB MySQL containers, and verify the impact to improve system resilience and fault‑tolerance.
ChaosBladeKuberneteschaos engineering
0 likes · 12 min read

Qunar shares how it built a large‑scale chaos engineering platform for thousands of microservices, detailing tool selection, architecture, evolution stages, fault‑injection scenarios, strong/weak dependency automation, open‑source contributions, and future plans for automated random drills.
Operationschaos engineeringcloud-native
0 likes · 9 min read

The article defines strong versus weak service dependencies, outlines governance through discovery, fault injection, and refactoring, recommends front‑end and back‑end fault‑tolerance measures such as timeouts and circuit breakers, describes isolation and artificial degradation switches, verifies classifications, and notes current middleware gaps and hiring information.
BackendHigh Availabilityfault injection
0 likes · 10 min read

iQIYI’s Little Deer Chaos Platform injects faults and runs red‑blue attacks across production services, enabling teams to validate alerts, circuit‑breakers, and fail‑over mechanisms—demonstrated by video playback and membership service case studies—thereby fostering zero‑trust design, faster skill growth, and resilient cloud‑native operations.
DevOpschaos engineeringfault injection
0 likes · 10 min read


DevOpsJun 15, 2021 · Operations
Netflix describes how it extended the academic Molly fault‑injection method into an automated, production‑scale failure‑testing system that explores dependency trees, defines success criteria, runs short low‑impact experiments, and discovers hidden faults before they affect users.
Molly algorithmNetflixautomated testing
0 likes · 9 min read


DevOpsJun 2, 2021 · Operations
Slack’s resilience engineering team outlines a structured chaos‑engineering workflow—identifying potential failures, ensuring fault tolerance, and deliberately injecting faults in development and production—to safely test system robustness, validate hypotheses, and continuously improve reliability through regular disaster‑theater exercises.
OperationsSlackchaos engineering
0 likes · 11 min read

This article explores the challenges of frontend availability, introduces chaos engineering concepts, and details Alibaba's practical approach to frontend fault injection—including static resource hijacking, a safe isolated environment, monitoring integration, and a real‑world drill that demonstrates how to measure and improve detection and response capabilities.
chaos engineeringfault injectionfrontend
0 likes · 18 min read

This article explains how to use ChaosBlade for fault injection and SkyWalking for monitoring to improve the high‑availability of distributed microservice systems, covering tool installation, experiment design, step‑by‑step execution, and real‑world case studies with detailed commands and metrics.
ChaosBladeSkyWalkingdistributed systems
0 likes · 15 min read

The article recounts a production outage caused by cloud‑platform network jitter, details step‑by‑step fault diagnosis using logs, APM and monitoring, reproduces the issue with chaos‑engineered Redis/Redisson faults, and outlines how the team turned the incident into a systematic fault‑drill practice.
RedisRedissonchaos engineering
0 likes · 20 min read

The article outlines a three‑stage ops maturity model—firefighting, fire prevention, and arson—explains how proactive fault‑injection drills, continuous availability improvements, and aligning technical metrics with business value can transform operations from reactive responders into strategic value creators.
Operationsavailabilityfault injection
0 likes · 8 min read


DevOpsAug 13, 2020 · Operations
This article outlines ByteDance’s adoption of chaos engineering, describing its background, industry examples, the evolution of internal fault‑injection platforms across three generations, the fault model and center design, experiment principles, and future plans for infrastructure‑level chaos and automated diagnostics.
Site Reliability Engineeringchaos engineeringdistributed systems
0 likes · 21 min read

This article explains how to construct a truly high‑availability architecture for modern distributed, cloud‑native services by covering disaster‑recovery principles, capacity planning with realistic load testing, online traffic protection, and systematic fault‑drill practices.
capacity planningdisaster recoveryfault injection
0 likes · 13 min read

This article details KuJiaLe's journey from monolithic to micro‑service architecture, the stability challenges encountered, and how they designed and deployed a ChaosBlade‑based fault‑injection platform that improves fault tolerance, accelerates incident response, and enhances overall user experience.
DevOpschaos engineeringfault injection
0 likes · 13 min read

This article describes Ctrip's SRE team's journey in adopting chaos engineering, outlining the motivations, roadmap, concrete experiments, platform maturity, and future automation goals to improve system resilience and operational reliability in a large‑scale microservice environment.
CtripOperationsPlatform
0 likes · 12 min read

This article describes ByteDance’s multi‑generation chaos engineering practice, covering industry background, fault‑injection models, the design of a declarative fault‑center, experiment selection principles, detailed experiment processes, metric classifications, red‑blue war‑game workflows, strong/weak dependency analysis, and future directions for infrastructure‑level chaos engineering.
Platform Designchaos engineeringfault injection
0 likes · 21 min read

The article explains Chaos Engineering as a discipline for deliberately injecting failures into distributed systems to uncover hidden weaknesses, outlines its five core principles, describes practical implementation steps and real‑world examples from Ctrip, and discusses future directions for reliability engineering.
Operationschaos engineeringdistributed systems
0 likes · 9 min read

This article demonstrates how to create Bash scripts that fully saturate CPU and I/O resources, explains their role in fault injection within the Simian Army framework, and introduces the broader concepts and benefits of chaos engineering for building resilient distributed systems.
bash scriptschaos engineeringcpu stress
0 likes · 9 min read

This article presents a comprehensive overview of chaos engineering, covering its definition, value, principles, implementation steps, enterprise adoption strategies, the open‑source ChaosBlade tool and AHAS Chaos platform, and two detailed case studies demonstrating fault injection experiments in a distributed service environment.
AHASAlibabaHigh Availability
0 likes · 15 min read

JVM‑Sandbox, an open‑source real‑time, non‑intrusive bytecode‑enhancement framework developed by Alibaba’s Technical Quality team since 2016, provides dynamic AOP, modular management, and HTTP‑based control to support fault injection, dependency analysis, recording/replay, and precise regression, dramatically improving testing efficiency and stability for large‑scale services.
bytecode instrumentationfault injectionjvm-sandbox
0 likes · 9 min read

This article explains how chaos engineering principles are applied to Ali Kubernetes by reviewing open‑source Kubernetes monkey tools, analyzing complex failure scenarios, and presenting a custom fault‑injection suite built on the internal MonkeyKing platform to enable flexible, scenario‑driven chaos experiments.
KubernetesMonkey Toolschaos engineering
0 likes · 10 min read

Alibaba’s MonkeyKing, inspired by Netflix’s Chaos Monkey, employs intentional fault injection—from random node kills to simulated network outages—to test and improve system robustness across IaaS, PaaS, and SaaS layers, offering a comprehensive model for reliability engineering in complex distributed environments.
AlibabaNetflixchaos engineering
0 likes · 8 min read

This article explains why chaos engineering is essential for distributed systems, distinguishes it from traditional fault testing, outlines practical inputs and principles, and details Alibaba's multi‑year experience with fault‑drill platforms, automation, and future plans to improve system reliability.
Alibabachaos engineeringdistributed systems
0 likes · 13 min read


AntTechDec 19, 2018 · Information Security
Ant Financial’s internal red‑blue technical attack‑defense program, driven by a dedicated blue team and SRE‑based red team, continuously probes system weaknesses, refines fault‑injection tools like Awatch, and evolves high‑availability and self‑healing mechanisms to strengthen risk control and operational reliability.
OperationsSREfault injection
0 likes · 10 min read

Meituan’s smart‑payment team combats growing complexity and third‑party failures by implementing a stability‑building program that raises availability through flexible degradation, rapid recovery, and three core QA practices—fault drills, online full‑link load testing, and a continuous operation system that standardizes processes, visualizes metrics, and automates resilience checks.
MeituanQAfault injection
0 likes · 13 min read

Qunar built a fault‑injection platform that dynamically injects runtime errors into its densely coupled backend services, enabling verification of degradation and circuit‑breaker strategies, with a four‑part architecture comprising a web UI, deployment system, command server, and Java agents using Instrumentation‑API for bytecode weaving.
AOPBackendJava Instrumentation
0 likes · 13 min read

This article describes the motivation, architecture, and implementation details of a fault‑injection platform that uses Java Instrumentation and dynamic bytecode weaving to validate high‑availability strategies, isolate failures, and support zero‑cost, runtime fault injection for complex distributed backend services.
AOPBackendHigh Availability
0 likes · 12 min read

Chaos engineering is a disciplined practice that injects controlled faults into distributed systems—often in production—to validate steady-state hypotheses, uncover hidden reliability weaknesses, and continuously improve resilience, as illustrated by the staged implementations and fault-injection techniques used by companies such as JD.com, Youzan, and Netflix.
chaos engineeringfault injectionreliability
0 likes · 11 min read


ITPUBNov 11, 2017 · Backend Development
This article examines JD.com’s technical strategies for the 2023 Double‑11 shopping festival, detailing dynamic load‑balancing and rate‑limiting mechanisms, evolving fault‑drill practices, and AI‑powered product and marketing enhancements that together ensure high‑concurrency stability and improved user experience.
AIJD.come-commerce
0 likes · 14 min read

The Fault‑Drill platform for hotel back‑end services combines real‑time traffic replication to shadow clusters with UI‑driven fault injection via a java‑agent, enabling developers to validate incident‑response plans, measure latency impacts, and reduce MTTR by testing normal and abnormal conditions on live traffic.
Backend Engineeringdistributed systemsfault injection
0 likes · 13 min read
