This article explains how to replace a slow Kettle‑based ETL process with Alibaba DataX, covering environment setup, compilation, Maven integration, Java invocation, and performance results that show a ten‑fold speed increase for syncing over a million records.
This article introduces DataEase, an open‑source BI platform built with SpringBoot, Apache Doris, and Kettle, explains its system and functional architecture, provides step‑by‑step installation commands and configuration details, and demonstrates how to create datasets, views, and dashboards for data analysis.
Kettle, a pure‑Java open‑source ETL tool (Chinese name "Shuihu"), enables efficient, installation‑free data extraction and synchronization, allowing you to copy tables or views from a SQL Server database directly into a MySQL table using a straightforward workflow.
This guide provides a step‑by‑step tutorial on preparing a Linux environment, installing Java, GNOME Desktop, VNC remote access, Chinese language support, downloading and extracting Kettle, configuring its startup scripts, creating desktop shortcuts, and managing essential Kettle configuration files for successful Hadoop ETL development.
This article provides an in-depth overview of ETL concepts, including extraction, transformation, loading, data warehouse architecture, and detailed discussion of Kettle (Pentaho Data Integration) features, design principles, components, transformations, jobs, database connections, metadata management, and practical examples for building robust data integration pipelines.
The article details WMDA's end‑to‑end data analytics architecture, covering zero‑event data collection, real‑time and offline processing pipelines built on Spark Streaming, Druid, Hadoop, Kettle, and TaskServer, and explains how these components collaborate to deliver comprehensive user behavior analysis.
