Big Data Technology & Architecture

Mar 27, 2019 · Big Data

Understanding State Management and Scaling in Apache Flink

This article explains how Apache Flink uses state for incremental stream processing, describes the different state backends, details the persistence mechanism, and shows how both OperatorState and KeyedState are redistributed during scaling using partition and key‑group algorithms.