Tagged articles
vectorized execution
26 articles · Page 1 of 1
Apache Auron graduates from incubation to become a top-level project after 13 months, delivering 2x faster Spark query performance and 50% resource savings via its Rust-native vectorized execution engine, already proven at exabyte scale across companies like Kuaishou, DiDi, and LinkedIn.
Apache ArrowApache AuronApache Spark
0 likes · 14 min read

This article provides a deep technical analysis of StarRocks' vectorized execution engine and cost-based optimizer, covering pipeline scheduling, vectorized operators, CodeGen/JIT compilation, statistics-driven cost modeling, parameter tuning strategies, and production troubleshooting methodologies for low-latency analytical queries.
CBO OptimizerCodeGenOLAP Database
0 likes · 40 min read

Tencent's SuperSQL achieved a 6.54 × 10⁸ TPC‑DS score—nearly ten times the previous best—while cutting unit performance cost to 11.04 yuan, about one‑sixth of earlier results, making it the global leader in both speed and price‑performance for 100 TB data analytics.
AI diagnosticsSuperSQLTPC-DS
0 likes · 17 min read

The article analyzes how migrating a large‑scale text deduplication workflow to Alibaba Cloud EMR Serverless Spark, using built‑in MinHash‑LSH functions and the Fusion Engine vectorized executor, reduces processing time from days to hours, cuts shuffle failures to zero, and eliminates most operational overhead.
AI data preprocessingEMR Serverless SparkFusion Engine
0 likes · 16 min read

The article benchmarks StarRocks internal tables against Paimon and Iceberg lake tables using TPCH 100G, shows internal tables excel at real-time analytics while lake tables optimize cold storage cost and multi-engine sharing, and details optimization strategies (metadata, data cache, predicate pushdown) achieving 5-10x speedup, illustrated by a retail case study cutting query latency from seconds to milliseconds and storage cost by 65%.
Data CacheHot-Cold TieringPaimon
0 likes · 9 min read


ITPUBOct 11, 2025 · Databases
This article details OceanBase's evolution from a distributed OLTP system to a unified HTAP database, covering its cost‑based optimizer, vectorized execution, integrated row‑column storage, bypass import, materialized views, external tables, full‑text search, and real‑world use cases for real‑time analytics.
HTAPMaterialized ViewOceanBase
0 likes · 12 min read

This article explores ClickHouse’s high‑performance OLAP architecture, covering its MPP design, columnar storage, vectorized execution, pre‑sorting, table engines, data types, sharding and replication strategies, as well as index designs that together enable rapid analysis of massive datasets.
ClickHouseData Compressioncolumnar storage
0 likes · 15 min read

This article examines ClickHouse’s high‑performance OLAP design, covering its MPP architecture, columnar storage, vectorized execution, pre‑sorting, table engines, extensive data‑type system, sharding and replication strategies, as well as its sparse and skip‑index mechanisms that together enable ultra‑fast analytics on massive datasets.
ClickHouseData PartitioningIndexing
0 likes · 16 min read

ClickHouse is an open‑source, massively parallel, column‑oriented OLAP database that integrates its own columnar storage, vectorized batch processing, pre‑sorted data, diverse table engines, extensive data types, sharding with replication, sparse primary‑key and skip indexes, and a multithreaded query engine, delivering high‑throughput real‑time analytics on massive datasets.
ClickHouseOLAPbig data
0 likes · 15 min read

This article compares ClickHouse and MySQL by examining benchmark results, MPP architecture, columnar storage, compression techniques, vectorized execution, and index designs, showing why ClickHouse delivers dramatically higher query performance on massive data sets.
ClickHouseMPPMySQL
0 likes · 8 min read

Blaze is a Rust‑implemented, DataFusion‑based vectorized execution engine created by Kuaishou to accelerate Spark SQL queries, delivering up to 60% faster computation, 30% average compute‑power gains in production, and extensive architectural innovations such as native engine, protobuf protocol, JNI bridge, and Spark extension, while being open‑source and compatible with Spark 3.0‑3.5.
DataFusionRustSpark
0 likes · 11 min read


ITPUBAug 29, 2024 · Databases
TeleDB’s journey from a centralized MySQL/PostgreSQL‑based system to a native distributed HTAP database showcases innovations such as share‑nothing architecture, columnar storage, vectorized execution, Remote Data Access, global caching, and advanced dead‑lock detection, dramatically improving query performance, storage efficiency, and scalability.
Distributed DatabaseHTAPTeleDB
0 likes · 13 min read

This article provides a detailed technical overview of Presto 2.0, the native C++ query engine built on the Velox library, covering its motivation, vectorized architecture, memory management, performance benchmarks from Meta and IBM, and deployment practices for large‑scale data warehouses.
C++SQLTPC-DS
0 likes · 15 min read

This article details Meituan's production‑grade adoption of Spark vectorized execution via the open‑source Gluten and Velox stack, explaining SIMD fundamentals, performance motivations, the end‑to‑end integration workflow, staged rollout, encountered challenges, and the resulting resource savings and speedups.
GlutenORCSpark
0 likes · 33 min read

The article summarizes a PrestoCon talk that reviews Meta's year‑long production experience with Prestissimo—a C++ Presto worker built on the Velox execution engine—highlighting its architecture, integration design, performance gains, and lessons for anyone considering Velox‑based vectorization.
C++MetaVelox
0 likes · 2 min read


ITPUBDec 18, 2022 · Databases
This article explains how ClickHouse achieves high query performance by leveraging storage‑engine designs such as pre‑sorting, columnar layout, and block‑level compression, and by exploiting a vectorized compute engine while avoiding joins and using built‑in functions.
ClickHouseCompressionDatabase Performance
0 likes · 9 min read

This article explains ClickHouse’s MPP columnar design, complete DBMS capabilities, columnar storage, vectorized execution, multi‑master architecture, real‑time queries, sharding, and performance‑focused hardware and algorithm choices that together deliver its superior speed.
ClickHouseColumnar DatabaseDatabase Architecture
0 likes · 17 min read

Youzan replaced ClickHouse and Druid with Apache Doris, refined its vectorized engine by eliminating deserialization overhead in the merge‑aggregation phase, achieving roughly a 30 % query‑time boost, and validated compatibility through SQL rewriting and traffic replay, while planning further SIMD‑based optimizations and broader adoption.
Apache DorisClickHouseDruid
0 likes · 8 min read

This article explains how StarRocks converts a SQL statement into an optimal distributed physical execution plan, schedules the plan across compute nodes, and runs it using MPP, pipeline parallelism, and vectorized execution to achieve near‑linear performance scaling.
CBO OptimizerDistributed DatabaseMPP
0 likes · 15 min read

ClickHouse is an MPP column‑oriented DBMS that combines full DBMS functionality, advanced columnar storage with high compression, SIMD‑based vectorized execution, a rich relational SQL interface, diverse table engines, multi‑master clustering, and flexible sharding and distributed query capabilities, making it exceptionally fast for analytical workloads.
ClickHouseDBMSSQL
0 likes · 21 min read

ClickHouse is a high‑performance MPP column‑store DBMS that combines complete DBMS functions, column‑oriented storage with aggressive compression, SIMD‑based vectorized execution, flexible table engines, multithreading, distributed processing, a multi‑master architecture, and SQL compatibility to deliver fast online analytical queries on massive data sets.
ClickHouseDBMScolumnar storage
0 likes · 21 min read


ITPUBOct 12, 2020 · Databases
This article explains how ClickHouse’s column‑oriented storage, vectorized execution engine, rich DBMS capabilities, flexible table engines, and carefully designed distributed architecture enable it to handle massive workloads with sub‑second query latency, making it a standout OLAP solution.
ClickHouseColumnar DatabaseData Compression
0 likes · 29 min read

This article explains how SparkR’s performance compares to native Spark APIs, shows the slowdown caused by JVM‑R serialization, and demonstrates how enabling Apache Arrow’s vectorized execution in Spark 3.0 can accelerate SparkR operations by up to dozens of times.
Apache ArrowSparkRperformance
0 likes · 7 min read

This article provides a comprehensive technical overview of ClickHouse, covering its complete DBMS capabilities, column‑oriented storage and compression, vectorized execution engine, relational SQL support, diverse table engines, multi‑master clustering, sharding, and the design philosophies that make it exceptionally fast for large‑scale analytical workloads.
ClickHouseColumnar DatabaseData Compression
0 likes · 29 min read

This article provides a comprehensive overview of OLAP data warehouses, covering classification by data volume and modeling, detailed explanations of MOLAP, ROLAP, HOLAP and HTAP, common open‑source implementations, and a deep dive into performance‑boosting techniques such as MPP architectures, cost‑based optimization, vectorized execution, dynamic code generation, storage compression, runtime filters and resource management.
Cost-Based OptimizationDynamic Code GenerationMPP
0 likes · 25 min read

This article provides a comprehensive overview of MonetDB, covering its origins at CWI, column‑oriented storage with BATs, memory‑mapped and vectorized execution, three‑layer system architecture, cache‑aware optimizations such as vector operations and radix‑partitioned hash joins, as well as its limitations and reference sources.
Columnar DatabaseMonetDBcache optimization
0 likes · 10 min read
