Understanding Hystrix: Service Isolation, Circuit Breaking, and Monitoring in Spring Cloud

Why Hystrix is Needed

Hystrix, originally contributed by Netflix, offers service isolation and fault tolerance for distributed systems, preventing cascading failures (service avalanche) that can render an entire application unavailable.

Key Features

Network latency and fault tolerance

Prevents service avalanche

Fast failure and graceful recovery

Service degradation (fallback)

Real‑time monitoring and alerts

Project Preparation

Include the Hystrix starter in the Maven pom.xml and enable the Hystrix dashboard.

<dependency>
    <groupId>org.springframework.cloud</groupId>
    <artifactId>spring-cloud-starter-netflix-hystrix</artifactId>
</dependency>
<dependency>
    <groupId>org.springframework.boot</groupId>
    <artifactId>spring-boot-starter-actuator</artifactId>
</dependency>

Thread Isolation Example

Define a Hystrix command with thread‑pool settings and a fallback method.

@HystrixCommand(
    groupKey = "order-service-getPaymentInfo",
    commandKey = "getPaymentInfo",
    threadPoolKey = "orderServicePaymentInfo",
    commandProperties = {@HystrixProperty(name = "execution.isolation.thread.timeoutInMilliseconds", value = "1000")},
    threadPoolProperties = {
        @HystrixProperty(name = "coreSize", value = "6"),
        @HystrixProperty(name = "maxQueueSize", value = "100"),
        @HystrixProperty(name = "keepAliveTimeMinutes", value = "2"),
        @HystrixProperty(name = "queueSizeRejectionThreshold", value = "100")
    },
    fallbackMethod = "getPaymentInfoFallback"
)
@RequestMapping(value = "/getpayment/{id}", method = RequestMethod.GET)
public ResultInfo getPaymentInfo(@PathVariable("id") Long id) {
    log.info(Thread.currentThread().getName());
    return restTemplate.getForObject(PAYMENT_URL + "/payment/get/" + id, ResultInfo.class);
}

public ResultInfo getPaymentInfoFallback(@PathVariable("id") Long id) {
    log.info("Fallback executed: " + Thread.currentThread().getName());
    return new ResultInfo();
}

Semaphore Isolation

Configure Hystrix to use semaphore isolation for lightweight resources.

@HystrixCommand(
    commandProperties = {
        @HystrixProperty(name = "execution.isolation.thread.timeoutInMilliseconds", value = "1000"),
        @HystrixProperty(name = HystrixPropertiesManager.EXECUTION_ISOLATION_STRATEGY, value = "SEMAPHORE"),
        @HystrixProperty(name = HystrixPropertiesManager.EXECUTION_ISOLATION_SEMAPHORE_MAX_CONCURRENT_REQUESTS, value = "6")
    },
    fallbackMethod = "getPaymentInfoFallback"
)
public ResultInfo getPaymentInfo(...){...}

Service Degradation (Fallback)

Define method‑level or class‑level fallback using @DefaultProperties(defaultFallback = "globalFallback") to handle timeouts, circuit‑breaker trips, or resource exhaustion.

Circuit Breaker Configuration

Enable the circuit breaker and set thresholds for request volume, error percentage, and sleep window.

@HystrixCommand(
    commandProperties = {
        @HystrixProperty(name = "circuitBreaker.enabled", value = "true"),
        @HystrixProperty(name = "circuitBreaker.requestVolumeThreshold", value = "10"),
        @HystrixProperty(name = "circuitBreaker.sleepWindowInMilliseconds", value = "10000"),
        @HystrixProperty(name = "circuitBreaker.errorThresholdPercentage", value = "60")
    },
    fallbackMethod = "getInfoFallback"
)
public ResultInfo get(@RequestParam Long id){...}

Request Collapsing (HystrixCollapser)

Batch multiple similar requests into a single call to reduce load.

@HystrixCollapser(
    scope = HystrixCollapser.Scope.GLOBAL,
    batchMethod = "getIds",
    collapserProperties = {
        @HystrixProperty(name = HystrixPropertiesManager.MAX_REQUESTS_IN_BATCH, value = "3"),
        @HystrixProperty(name = HystrixPropertiesManager.TIMER_DELAY_IN_MILLISECONDS, value = "10")
    }
)
@RequestMapping(value = "/getId", method = RequestMethod.GET)
public ResultInfo getId(@RequestParam Long id){...}

public List<ResultInfo> getIds(List<Long> ids){...}

Hystrix Dashboard and Turbine

Add spring-cloud-starter-netflix-hystrix-dashboard and expose /hystrix.stream via a servlet bean. Use Turbine to aggregate streams from multiple services (e.g., order and payment) for unified monitoring.

@Component
public class HystrixConfig {
    @Bean
    public ServletRegistrationBean getServlet() {
        HystrixMetricsStreamServlet streamServlet = new HystrixMetricsStreamServlet();
        ServletRegistrationBean registrationBean = new ServletRegistrationBean(streamServlet);
        registrationBean.setLoadOnStartup(1);
        registrationBean.addUrlMappings("/hystrix.stream");
        registrationBean.setName("HystrixMetricsStreamServlet");
        return registrationBean;
    }
}

The dashboard visualizes request latency, error rates, thread pool usage, and circuit‑breaker status, helping operators detect and mitigate service degradation in real time.