BestHub
search
Sign in
Tag

Streaming ETL

1 views collected around this technical thread.

Big Data Technology Architecture
Big Data Technology Architecture
Nov 30, 2021 · Big Data

Building a Real-Time MySQL and PostgreSQL Streaming ETL with Flink CDC

This tutorial shows how to quickly construct a streaming ETL pipeline that captures changes from MySQL and PostgreSQL using Flink CDC, enriches order data with product and shipment information, and writes the results into Elasticsearch for real‑time visualization in Kibana.

CDCDockerElasticsearch
0 likes · 11 min read
Building a Real-Time MySQL and PostgreSQL Streaming ETL with Flink CDC
Architecture Digest
Architecture Digest
Jun 10, 2021 · Big Data

NetEase Game Streaming ETL Architecture and Practices Based on Flink

This article presents NetEase Game's streaming ETL solution built on Flink, covering business background, log characteristics, specialized and generic ETL services, architectural evolution, Python UDF integration, runtime optimizations, fault‑tolerance mechanisms, and future roadmap for unified real‑time and offline data warehouses.

Data PipelineFlinkPython UDF
0 likes · 19 min read
NetEase Game Streaming ETL Architecture and Practices Based on Flink