Tagged articles
Kudu
24 articles · Page 1 of 1
Kudu is an MIT-licensed open-source desktop toolkit that combines system cleaning, security scanning, and performance monitoring for Windows, macOS, and Linux, featuring local-only operation, no ads, JSON-defined cleaning rules, CLI and GUI modes, and privacy-focused design.
ElectronKuduPerformance Monitoring
0 likes · 10 min read

This case study details how an online education platform migrated its real‑time data warehouse from Kudu to Alibaba Cloud Hologres, overcoming technical bottlenecks, reducing operational costs by nearly a million dollars annually, and achieving higher throughput, lower latency, and easier maintenance across multiple business scenarios.
HologresKuduOLAP
0 likes · 16 min read


21CTOOct 6, 2021 · Big Data
This article details the design and implementation of a real‑time, TB‑scale bill‑detail query platform that leverages Kafka for streaming, Debezium and Confluent Platform for change capture, Kudu for low‑latency storage, and Presto/Kylin for fast OLAP queries, while outlining deployment, integration, and future enhancements.
KafkaKudupresto
0 likes · 19 min read

This article details the requirements, architecture, and implementation of a real-time and offline integrated query system, covering data ingestion via Debezium and Confluent Platform, storage in Kudu and HDFS, query engines Presto and Kylin, and strategies for data synchronization, partitioning, and scaling.
DebeziumKafkaKudu
0 likes · 19 min read

Kudu is an open‑source columnar storage engine from Cloudera that combines high‑throughput batch processing with low‑latency random reads, offering features such as C++/Java APIs, Raft‑based replication, flexible consistency, partitioning, and integration with Hadoop, Spark, Impala, and other ecosystem components.
HadoopKuducolumnar storage
0 likes · 64 min read

This article provides a side‑by‑side technical comparison of HBase, Kudu, and ClickHouse, covering their installation dependencies, architectural designs, read/write workflows, query capabilities, real‑world use cases at Didi, NetEase, and Ctrip, and practical operational tips.
ClickHouseHBaseKudu
0 likes · 20 min read

This article provides step‑by‑step guidance on importing data into Kudu via Sqoop and Impala, performance tuning recommendations for Impala‑Kudu workloads, best practices for queries, data deletion, comparisons with Parquet, and a brief overview of StreamSets as an ETL tool.
ETLImpalaKudu
0 likes · 6 min read

This article provides a comprehensive technical comparison of HBase, Kudu, and ClickHouse—covering installation dependencies, architecture, basic read/write and query operations, real‑world use cases at Didi, a Kudu‑based real‑time data warehouse, and ClickHouse log‑analysis practices—highlighting each system’s strengths and trade‑offs for big‑data workloads.
ClickHouseHBaseKudu
0 likes · 17 min read

This article introduces NetEase's real-time computing platform Sloth, detailing its architecture, component layers, integrated IDE, operational tooling, unified metadata management, challenges such as Kudu write amplification, and proposes a tiered real‑time data‑warehouse model with a vision for storage‑compute separation and unified batch‑stream APIs.
FlinkKafkaKudu
0 likes · 13 min read

This article provides a step‑by‑step tutorial on deploying a Spark‑based advertising data pipeline using Kudu, covering Hadoop setup, HDFS data loading, Spark application refactoring, Maven packaging, Yarn execution, and crontab scheduling for daily automated runs.
HadoopKuduMaven
0 likes · 11 min read

This article demonstrates how to implement an advertising business data statistics pipeline using Spark and Kudu, detailing metric requirements, Scala processing code, complex SQL aggregations, schema design, and data sinking for verification.
KuduSQLScala
0 likes · 7 min read

This article walks through the complete implementation of an advertising statistics pipeline using Spark and Kudu, covering requirement analysis, Scala code development, SQL queries, schema definition, and data sinking, with full code snippets and execution results.
KuduSQLScala
0 likes · 7 min read

This article walks through a Spark and Kudu advertising project, explaining the refactoring approach, Scala trait usage, implementation of ETL and province‑city statistics processors, and shows the complete Spark application entry point with full code examples.
ETLKuduScala
0 likes · 7 min read

This tutorial walks through a Spark‑Kudu advertising project that computes province‑city distribution statistics using SQL, defines the necessary schema, and demonstrates how to write the aggregated results back to a Kudu table for persistent storage, complete with Scala code examples.
Data EngineeringKuduSQL
0 likes · 4 min read

This tutorial describes how to place advertising JSON data on HDFS, use Spark for ETL and analysis, enrich logs with IP lookup, and persist the results into Kudu with daily scheduling, including code examples and schema definitions.
ETLIP lookupKudu
0 likes · 17 min read

This guide demonstrates how to configure a Spark Streaming application running on YARN in cluster mode to securely consume Kerberos‑protected Kafka topics and write the processed data into Kudu tables, including necessary Java code, Kerberos keytab setup, Kafka client configuration, and spark‑submit commands.
JavaKafkaKerberos
0 likes · 11 min read

This article describes how Kuaishou leverages Apache Flink for large‑scale real‑time multi‑dimensional analytics, details the architecture of its analytics platform using Kudu storage and KwaiBI, and introduces SlimBase—a lightweight, embedded shared state backend that replaces RocksDB to reduce I/O, latency, and CPU overhead.
FlinkKuaishouKudu
0 likes · 17 min read

This article, originally shared by NetEase’s data expert Jiang Hongxiang on DataFun, outlines the construction of NetEase’s data foundation platform, covering database kernel insights and the implementation of the ad‑hoc query engine Impala with the distributed storage system Kudu, offering valuable big‑data engineering practices.
Data InfrastructureImpalaKudu
0 likes · 4 min read

Facing MySQL performance bottlenecks at massive scale, Xiaomi built the LCSBinlog service that captures MySQL binlog events, streams them through the Talos platform, and writes to Kudu for real‑time BI, detailing architecture, job scheduling, consistency guarantees, use cases, and troubleshooting lessons.
CDCKuduMySQL
0 likes · 13 min read

This article provides a comprehensive introduction to Apache Kudu, covering its origins, cluster architecture with Raft consensus, table schema and partitioning design, and detailed storage mechanisms including MemRowSet, DiskRowSet, CFile, and compaction processes.
Database ArchitectureDistributed SystemsKudu
0 likes · 11 min read

This article provides a comprehensive introduction to Apache Kudu, covering its origins, cluster architecture with Raft consensus, schema‑based table and partition design, and the intricate storage engine that combines in‑memory and on‑disk structures to deliver fast OLTP and OLAP capabilities on fast data.
KuduRaft ConsensusTable Design
0 likes · 12 min read

This article presents NetEase Hangzhou Research Institute's experience in building a data infrastructure, covering database innovations such as InnoSQL, NTSDB, and InnoRocks, as well as the integration of big‑data components like HDFS, Spark, Impala, and Kudu to enable efficient storage, processing, and real‑time analytics.
ImpalaInnoSQLKudu
0 likes · 12 min read

This article summarizes the latest releases and feature updates in the big data ecosystem—including Hadoop 3.0 Alpha, Druid 0.9.2, Apache Kudu 1.1.0, HAWQ 2.1.0 enterprise—as well as a brief overview of Docker’s 2015‑2016 version history and its adoption status in China.
DruidHAWQHadoop
0 likes · 18 min read

The article outlines Meituan‑Dianping’s “Sensors Analytics” platform, a privately‑deployed, open‑PaaS solution that collects full‑stack user events from iOS, Android, Web and WeChat, maps IDs in near real‑time, stores detailed records in Kudu (real‑time) and Parquet (offline), and serves low‑latency queries via Impala, addressing the architectural and operational challenges of high‑throughput ingestion and data‑security requirements.
ImpalaKafkaKudu
0 likes · 8 min read
