Tagged articles
Distributed Query
20 articles · Page 1 of 1
Elasticsearch achieves billion‑scale search performance by combining horizontal sharding, immutable inverted‑index segments, a two‑stage distributed Query/FETCH model, and multiple replicas with a coordinator node to ensure high concurrency, scalability, and availability.
Distributed QueryElasticsearchReplication
0 likes · 4 min read

This article explains how Xiaohongshu built the REDgraph graph database to tackle ultra‑large social network queries, compares graph databases with traditional relational databases, showcases a Gremlin example, and highlights the scalability and efficiency benefits of storing relationships as first‑class citizens.
Distributed QueryGremlinNoSQL
0 likes · 6 min read

This article explains ClickHouse’s core architecture—including its storage‑compute integration, MPP parallelism, columnar storage, vectorized execution, data pre‑sorting, table engines, sparse and auxiliary indexes, and the two‑stage aggregation pipeline—then walks through the exact GROUP BY execution flow for both local and distributed tables, illustrating each step with diagrams, SQL demos, and code snippets.
ClickHouseDistributed QueryHashMap
0 likes · 29 min read

This article compares API composition and CQRS patterns for handling distributed queries in evolving monolithic systems, illustrating their workflows with e‑commerce and online‑education examples, discussing performance trade‑offs, implementation details using Canal and ElasticSearch, and offering practical guidance on when to adopt each approach.
API compositionCanalDistributed Query
0 likes · 8 min read

Xiaohongshu's REDgraph graph database faced high latency for multi‑hop queries, so the storage team redesigned the query framework using MPP‑inspired distributed parallel execution, edge‑partitioning, operator forwarding, and caching, achieving over 50% latency reduction and making three‑hop queries viable for online services.
Distributed QueryREDgraphgraph-database
0 likes · 30 min read

This article explains how to keep MySQL and Elasticsearch data in sync using synchronous calls, asynchronous notifications, or binlog listeners, and dives deep into Elasticsearch cluster design, node roles, distributed storage, query phases, split‑brain handling, and fault‑tolerance mechanisms.
Cluster ArchitectureDistributed QueryElasticsearch
0 likes · 8 min read

This article presents the design, challenges, and performance‑focused optimizations of REDgraph, a large‑scale graph database used at Xiaohongshu, detailing its architecture, edge‑partitioning strategy, distributed parallel query implementation, and experimental results that demonstrate significant latency reductions for multi‑hop queries.
Distributed QueryREDgraphgraph database
0 likes · 25 min read

This article explains the concept of data federation, its advantages over traditional ETL, key architectural components, practical use cases such as virtual ODS, data staging, warehouse extension, heterogeneous migration, and compares Presto and Trino as distributed query engines for unified, secure, and low‑cost data access.
Distributed QueryETL alternativedata federation
0 likes · 21 min read

The article explains how ByteHouse extends ClickHouse with a full‑featured query optimizer—including rule‑based and cost‑based techniques, analyzer modules, plan construction, and distributed optimization—to overcome ClickHouse limitations and achieve significant performance gains on complex OLAP workloads.
ByteHouseCBODistributed Query
0 likes · 10 min read

This article explains how ByteHouse (a heavily optimized ClickHouse variant) tackles complex query challenges by introducing a multi‑stage execution model, exchange mechanisms, runtime filters, and network optimizations, and it presents performance results and future directions for large‑scale OLAP workloads.
ByteHouseClickHouseDistributed Query
0 likes · 21 min read


ITPUBSep 12, 2022 · Databases
This article explains how ByteHouse, a heavily optimized fork of ClickHouse, introduces a multi‑stage execution model, advanced exchange mechanisms, and runtime filters to overcome the limitations of the original two‑stage query flow, delivering significant performance gains for complex joins, aggregations, and large‑scale analytics workloads.
ByteHouseClickHouseDatabase Engineering
0 likes · 22 min read

This article presents the cloud‑native redesign of ClickHouse, covering its current technical limitations in storage and computation, the proposed storage‑compute separation with DDL task management, multi‑replica and CommitLog mechanisms, and a new MPP query layer to meet future data‑warehouse demands such as real‑time analytics, flexibility, high throughput, low cost, and support for semi‑structured data.
ClickHouseDistributed QueryMPP
0 likes · 15 min read

The article explains how a Citus cluster—comprising a coordinator and multiple workers—splits and routes SQL queries, detailing the distributed planner, executor, push‑pull handling of subqueries/CTEs, and a step‑by‑step EXPLAIN walkthrough of a top‑20 page‑views query.
CitusDistributed QueryEXPLAIN
0 likes · 10 min read

Boussole is Shopee’s real‑time analytics engine that transforms each dimension into key‑value pairs stored primarily in HBase, pre‑aggregates selected dimension combos, hashes metrics and tags, executes distributed PromQL queries with a CockroachDB‑inspired executor, applies Delta‑of‑Delta compression and point‑capping, and continues to evolve with adaptive pre‑aggregation and new storage models to maintain millisecond latency for massive multi‑dimensional analysis.
Distributed QueryPromQLTime Series
0 likes · 24 min read

This article demonstrates how to use the Explain feature in DBLE to visualize distributed query plans, compare join orders across multiple SQL statements, identify Cartesian products and ordered joins, and apply optimization insights for better performance in multi‑table queries.
DBLEDistributed QueryEXPLAIN
0 likes · 6 min read

XSQL is an open‑source, low‑threshold, highly stable distributed query engine that supports federated queries across heterogeneous data sources, offering push‑down optimization, metadata decentralization, multi‑engine integration, and seamless deployment on Spark/YARN for real‑time big‑data analytics.
Distributed QuerySQL FederationSpark
0 likes · 14 min read


ITPUBJun 22, 2017 · Databases
This article explains how the DRIVING_SITE hint can reduce network traffic in Oracle distributed queries by pushing small tables to the remote site, demonstrates setup steps, compares execution times with and without the hint, and provides concrete PL/SQL scripts for performance testing.
DBLINKDistributed QueryOracle
0 likes · 9 min read


ITPUBMar 23, 2017 · Databases
This article explains how to use Oracle's driving_site hint to minimize network traffic in distributed DBLINK queries, demonstrates a banking case where execution time drops from over eight seconds to under one second, and provides step‑by‑step view‑based solutions for DML optimization.
Distributed QueryOracleSQL
0 likes · 8 min read

This article details the motivation, architectural iterations, caching strategies, SparkSQL enhancements, and performance benchmarks of Baidu's PINGO platform, illustrating how it transformed from a Hive‑based QueryEngine into a high‑performance, Spark‑driven interactive query system for large‑scale data analysis.
CachingDistributed QueryPINGO
0 likes · 14 min read

This article explains how to optimize Oracle distributed queries that involve remote tables by minimizing remote calls, reducing result set size, and improving execution plans through techniques such as collocated inline views, CBO behavior, and driving_site hints, illustrated with detailed examples and performance measurements.
Collocated ViewDatabase PerformanceDistributed Query
0 likes · 11 min read
