Tagged articles
health-checks
30 articles · Page 1 of 1
A comprehensive guide to configuring Nginx upstream for reliable traffic distribution, covering environment validation, weighted round-robin, least_conn, consistent hashing, passive health checks, failover strategies, observability with structured logs, canary deployments, and safe rollback procedures.
FailoverOperationscanary deployment
0 likes · 38 min read

This article provides a comprehensive decision framework for choosing between Layer 4 and Layer 7 load balancing, covering protocol analysis, TLS termination, health checks, session persistence, canary deployments, observability, and rollback procedures using HAProxy as a reference implementation.
HAProxyLayer 4 Load BalancingLayer 7 Load Balancing
0 likes · 27 min read

This article provides a comprehensive guide to configuring Nginx as a load balancer for multiple large language model instances, covering upstream equivalence checks, algorithm selection, proxy settings for streaming, health checks, logging, rate limiting, session affinity, config change procedures, maintenance draining, troubleshooting common errors, and validation standards.
LLMOperationsProxy Configuration
0 likes · 34 min read

A comprehensive guide to deploying Keepalived with Nginx for high availability, covering VRRP mechanics, health-check design, split-brain prevention, failover testing, and cloud-environment nuances, with concrete configs and verification steps.
FailoverHigh AvailabilityKeepalived
0 likes · 64 min read

This article analyzes load balancing selection between Layer 4 (LVS, cloud NLB) and Layer 7 (Nginx, cloud ALB) through real failure cases, covering core concepts, deployment guides, capacity planning, monitoring, and troubleshooting to help architects place each function at the right network layer.
LVSTLS offloadingcapacity planning
0 likes · 71 min read

This article details a production-grade high-availability framework for vLLM-based LLM inference services on Kubernetes, covering layered health checks, multi-level model warmup, automated failover, degradation strategies, metrics-driven alerting, and troubleshooting patterns derived from real incidents.
FailoverGPUHigh Availability
0 likes · 57 min read

This comprehensive guide dissects Spring Boot's graceful shutdown internals and health check semantics, revealing why configuring server.shutdown=graceful alone fails to prevent request loss during Kubernetes rolling updates, and provides a complete framework for coordinating shutdown phases, probe groups, and routing convergence to achieve true zero-downtime deployments.
ActuatorKubernetesProduction Readiness
0 likes · 36 min read

Explores observability fundamentals including its three pillars (logs, metrics, tracing), structured logging with Serilog message templates, OpenTelemetry distributed tracing with W3C TraceContext propagation, ASP.NET Core health checks for Kubernetes liveness/readiness probes, and production monitoring architecture with correlation, standardization, sampling, and alerting strategies.
Distributed TracingKubernetesOpenTelemetry
0 likes · 27 min read

This article details a practical blue-green deployment workflow using Nginx and Docker on a single Linux server, covering health checks, version verification, candidate validation, atomic Nginx upstream switching, rollback procedures, database compatibility, static asset versioning, and graceful shutdown of old instances.
DockerOperationsblue-green-deployment
0 likes · 34 min read

This article compares LVS (Layer 4) and Nginx (Layer 7) load balancers, explaining why LVS achieves higher throughput by only inspecting IP headers while Nginx terminates TCP connections for HTTP-aware routing, health checks, and request retry — at the cost of added latency and configuration complexity.
High AvailabilityLVShealth-checks
0 likes · 11 min read

This article details a four-step container routing mechanism (authentication, permission, routing, resolution) for an Agent platform, explaining how requests reach different container forms based on identity and instance health, and why distinguishing hard vs soft failures is critical for debugging.
Authenticationagent platformauthorization
0 likes · 27 min read

This comprehensive guide covers Docker core concepts, common operations for images, containers, volumes, and networks, Dockerfile best practices, Docker Compose, production hardening with security and resource limits, logging, health checks, troubleshooting techniques, and solutions for common issues like slow pulls, data loss, time zones, DNS, and disk space.
Container OperationsData VolumesDocker
0 likes · 31 min read

A practical guide to diagnose Kubernetes pod frequent restarts by distinguishing OOMKilled from liveness probe failures, using kubectl describe, logs, and events, then fixing via memory limit adjustments or probe parameter tuning (initialDelaySeconds, periodSeconds, timeoutSeconds, failureThreshold), while avoiding common pitfalls like confusing liveness/readiness probes or depending on external dependencies for health checks.
KubernetesLiveness ProbeMemory Limits
0 likes · 8 min read

This guide walks through installing HAProxy 2.x, configuring L4 TCP and L7 HTTP/HTTPS load balancing for web, MySQL, and Redis, setting up health checks, session persistence, monitoring, high‑availability with Keepalived, performance tuning, security hardening, and step‑by‑step zero‑downtime deployment and rollback procedures.
HAProxyHigh Availabilityhealth-checks
0 likes · 36 min read

Envoy, the high‑performance edge and service‑mesh proxy, offers three core mechanisms—service discovery, load balancing, and health checking—each with multiple configurable options and code examples, enabling operators and developers to optimize distributed systems for scalability, reliability, and performance in cloud‑native environments.
Envoyhealth-checksservice mesh
0 likes · 9 min read

This article reveals the most frequent Kubernetes pitfalls—from missing resource requests and health checks to over‑privileged containers and lack of monitoring—provides concrete examples, code snippets, and practical recommendations to help you configure a stable, secure, and efficient cloud‑native environment.
Best PracticesKuberneteshealth-checks
0 likes · 14 min read

OpenAI’s engineering team details how they expanded a Kubernetes cluster to 7,500 nodes to support massive models like GPT‑3, CLIP, and DALL·E, describing workload characteristics, networking redesign, API server pressure, monitoring, health checks, resource quotas, and the remaining open problems.
API ServerKubernetesPrometheus
0 likes · 19 min read

This article presents practical Kubernetes best‑practice cases—including horizontal autoscaling, service discovery with load‑balancing, and health‑check probes—to help engineers build more reliable, scalable, and self‑healing container deployments.
Best PracticesKubernetesService Discovery
0 likes · 8 min read

This article explains how to design and operate resilient microservice systems by using patterns such as graceful degradation, change management, health checks, self‑healing, failover caching, retry logic, rate limiting, circuit breakers, and testing failures to minimize downtime and improve reliability.
fault tolerancehealth-checksload-balancing
0 likes · 13 min read

This article explains how to build highly available microservice systems by addressing the risks of distributed architectures, employing graceful degradation, change management, health checks, self‑healing, failover caching, retry and rate‑limiting strategies, bulkhead and circuit‑breaker patterns, and continuous failure testing.
Deployment Strategiesfault tolerancehealth-checks
0 likes · 18 min read

This article explains how to build highly available microservice systems by applying fault‑tolerance patterns such as graceful degradation, health checks, self‑healing, failover caches, retries, rate limiting, bulkhead isolation, circuit breakers, and systematic failure testing, while also covering change‑management and deployment strategies.
Circuit Breakerfault tolerancegraceful degradation
0 likes · 14 min read

The article explains how to build highly available microservice systems by isolating failures, applying graceful degradation, change‑management, health checks, self‑healing, fallback caches, circuit breakers, retry policies, rate limiting and testing strategies, while acknowledging the cost and operational complexity involved.
Circuit BreakerRetrychange management
0 likes · 16 min read

The article explains how microservices can achieve resilience through health reporting, diagnostics, standardized logging, health‑check implementations, and orchestrator coordination to detect failures, restart services, handle upgrades, and recover from partial cloud‑based failures.
Resiliencediagnosticshealth-checks
0 likes · 9 min read

This case study outlines iQIYI's LEDAO middle‑platform monitoring challenges, evaluates open‑source solutions, details the selection and customization of CAT, and presents deployment, integration, health‑check, and alerting enhancements that now support over 100 microservices across multiple regions.
CATSystem Monitoringalerting
0 likes · 12 min read

This article examines the inherent risks of microservice architectures and presents practical patterns—such as graceful degradation, change management, health checks, self‑healing, fallback caching, retries, rate limiting, bulkheads, and circuit breakers—to build highly available, fault‑tolerant services.
Circuit BreakerResiliencebulkhead
0 likes · 15 min read

This guide explains why service discovery is essential, details Consul's internal architecture, walks through building a Docker‑based Consul cluster, shows how to register services, query them via HTTP API or DNS, and covers health checks, deregistration, and alternative deployment patterns.
DockerService DiscoveryService Registration
0 likes · 20 min read

This article shares the 2019 container‑migration experience of an e‑commerce team, covering Docker and Kubernetes fundamentals, Java‑specific memory and CPU limits, JDK version tuning, log collection, multi‑stage image builds, health‑check strategies, common pitfalls, and best‑practice recommendations for cloud‑native deployments.
ContainerizationDockerJava
0 likes · 22 min read

This article explains why service discovery is essential for microservice architectures, dives into Consul’s internal mechanisms—including multi‑datacenter gossip, Raft consensus, and client‑server roles—then provides step‑by‑step Docker deployment, service registration, health‑check configuration, and practical discovery methods via HTTP API and DNS.
DockerService Discoveryconsul
0 likes · 20 min read

This article explains how Kubernetes health checks—Readiness and Liveness probes—work, the differences between them, practical scenarios for their use, and how to configure probe types, delays, and thresholds to build more resilient cloud‑native applications.
KubernetesLiveness ProbeReadiness Probe
0 likes · 8 min read


21CTOJun 7, 2016 · Operations
This article explores the fundamentals and advanced techniques of load balancing, compares DNS round‑robin with dedicated load balancers, discusses scaling strategies, health‑check mechanisms, and introduces Alibaba’s VIPServer as a modern mid‑tier solution addressing real‑world operational challenges.
Cloud OperationsVIPServerdistributed systems
0 likes · 21 min read
