Tagged articles
DataStream
12 articles · Page 1 of 1
This guide shows how to deploy Apache Flink 1.17 in Docker, configure off‑heap memory, connect it to Pulsar via the 4.1.0‑1.17 connector, run example jobs that copy topics and perform windowed word‑count, and provides Maven dependencies, custom serialization tips, batching settings, and version‑specific best‑practice notes.
Apache FlinkDataStreamDocker deployment
0 likes · 20 min read

The article explains how to archive Kafka real‑time data to Hive using either Flink SQL, which quickly creates partitioned ORC tables but requires timezone handling, or Flink DataStream for more complex pipelines, and offers best‑practice guidance on data quality, system complexity, security, and performance.
Data ArchivingDataStreamFlink
0 likes · 15 min read

This article provides a detailed tutorial on implementing various dual‑stream join techniques—including processing‑time, event‑time, and interval joins—using Flink CDC 2.2 and Flink 1.14 with the Java DataStream API, complete with code examples, SQL setup, and execution results.
CDCDataStreamFlink
0 likes · 31 min read

This article explains how to use Flink's DataStream.union() to combine multiple streams of the same type, demonstrates Maven project setup and code examples for simple unions and for unions with custom event-time sorting, and shows the resulting ordered output.
DataStreamEventTimeFlink
0 likes · 15 min read

This article explains why Elasticsearch is being adapted as a time‑series engine, outlines its unique characteristics and challenges such as high query complexity and storage cost, and introduces Alibaba Cloud’s TimeStream solution with optimizations like index settings, compression, down‑sampling, and Prometheus integration.
DataStreamElasticsearchTime Series
0 likes · 13 min read

This article provides a detailed introduction to FlinkSQL, covering its background, the Table API, required dependencies, differences between old and Blink planners, various API usage patterns, connector configurations for CSV, Kafka, Elasticsearch, MySQL, and how to convert between DataStream and Table in Flink's unified batch‑stream processing model.
ConnectorDataStreamFlinkSQL
0 likes · 23 min read

This article provides a comprehensive overview of Apache Flink SQL 1.13, detailing new Window TVF support, cumulate windows, performance optimizations, time‑zone handling, enhanced Hive compatibility, SQL client upgrades, DataStream‑Table conversion improvements, and outlines the roadmap for the upcoming 1.14 release.
DataStreamFlinkHive Integration
0 likes · 15 min read

This article explains how Flink 1.12 introduces production‑grade Kubernetes high‑availability, details the underlying architecture and deployment steps, and shows how the DataStream API can run in batch mode using runtime‑mode configuration and example commands.
Apache FlinkDataStreamHigh Availability
0 likes · 12 min read

This article introduces Apache Flink's Streaming SQL, explains its theoretical foundations such as the table‑stream relationship and watermark semantics, describes the platform's practical enhancements—including source/sink wrappers, built‑in functions, and native Retract Stream support—and showcases several real‑time computation examples.
Apache FlinkDataStreamReal-time Computing
0 likes · 31 min read

Flink’s StreamPartitioner abstracts data routing in DataStream, offering eight built‑in partitioners—including Global, Shuffle, Rebalance, KeyGroup, Broadcast, Rescale, Forward, and Custom—each with distinct channel selection logic, illustrated with source code snippets and explanations of their runtime behavior.
DataStreamFlinkJava
0 likes · 8 min read

This article introduces Apache Flink’s Table API and SQL, explains the TableEnvironment programming model, shows how to register tables and sinks, and provides two complete Java examples—WordCount and a file‑based aggregation—complete with code that can be downloaded for local testing.
DataStreamFlinkJava
0 likes · 7 min read

This article introduces the design and implementation of a real‑time user behavior engineering platform at Qunar using Apache Flink, covering Flink's core characteristics, distributed runtime, DataStream programming model, fault‑tolerance, back‑pressure handling, event‑time processing, windowing, watermarks, and practical code examples for filtering, splitting, joining, and state management.
DataStreamEventTimeFlink
0 likes · 18 min read
