BestHub
Sign in
Tagged articles

Unaligned Checkpoint

3 articles · Page 1 of 1
Lakehouse Research Base
Lakehouse Research Base
Sep 29, 2026 · Big Data

Inside Flink Checkpoint: Barrier Alignment, Unaligned Snapshots & RocksDB Recovery

This article provides a deep technical analysis of Apache Flink's checkpoint mechanism, covering barrier alignment and unaligned snapshots, heap vs RocksDB state backends with incremental checkpoints, savepoint vs checkpoint differences, failure recovery flows, and practical troubleshooting for checkpoint timeouts, state bloat, and recovery slowness.

Apache FlinkBarrier AlignmentCheckpoint
0 likes · 26 min read
Inside Flink Checkpoint: Barrier Alignment, Unaligned Snapshots & RocksDB Recovery
Shopee Tech Team
Shopee Tech Team
Oct 13, 2022 · Big Data

Improving Flink Unaligned Checkpoint: Problems, Principles, Optimizations, and Production Practices at Shopee

Shopee tackled frequent Flink checkpoint failures caused by back‑pressure by adopting and extending the community’s Unaligned Checkpoint mechanism—adding overdraft buffers, improving legacy sources, introducing an aligned‑checkpoint timeout, enabling output‑buffer switching, merging small HDFS files, and fixing network‑buffer deadlocks—now running hundreds of jobs with stable UC deployment and plans to enable it universally.

Checkpoint OptimizationFlinkShopee
0 likes · 18 min read
Improving Flink Unaligned Checkpoint: Problems, Principles, Optimizations, and Production Practices at Shopee