Tagged articles
Bitmap Index
22 articles · Page 1 of 1
This official technical reference details Paimon's file-level index architecture, covering BloomFilter, Bitmap V2, and Range Bitmap indexes with binary storage formats, configuration parameters, hash rules, supported data types, and SQL optimization examples for equality, range, AND/OR, and TOPN queries.
Binary FormatBitmap IndexBloomFilter
0 likes · 12 min read

This comprehensive guide covers Bitmap index internals, cardinality thresholds, index replacement rules, and layered optimization combining partition pruning, BloomFilter, and Range-Bitmap for StarRocks querying Paimon tables, with official binary formats, production thresholds, and real-world case studies.
Apache PaimonBitmap IndexBloomFilter
0 likes · 26 min read

This guide details the four index types in StarRocks 3.3—Bitmap, Bloom Filter, N-Gram Bloom Filter, and Full-Text Inverted Index—covering their core principles, supported data types, creation syntax, ideal use cases (low/high cardinality, fuzzy/long-text queries), anti-patterns, and real-world optimization examples with performance metrics.
Bitmap IndexBloom FilterN-Gram Bloom Filter
0 likes · 27 min read

Facing daily data growth from millions to 150 billion records, Joydata‑U transformed its analytics platform through three architectural stages—Hadoop, Hadoop + Trino, and finally StarRocks—introducing resource isolation, Flat JSON acceleration, and Bitmap indexing to cut query latency by up to seven times and achieve sub‑2‑minute data freshness across BI, ad‑tech, game analytics, and CRM workloads.
Bitmap IndexFlat JSONFlink
0 likes · 12 min read

This article explains the purpose and inner workings of various database indexing algorithms—including B‑Tree, Hash, Bitmap, and Full‑Text indexes—illustrates their strengths and weaknesses with SQL examples, and provides guidance on when to choose each type for optimal query performance.
B+TreeBitmap IndexSQL
0 likes · 12 min read

The article explains how Hologres RoaringBitmap compresses user ID sets into efficient bitmap indexes, splits 64‑bit IDs into buckets, syncs them from MaxCompute, and enables sub‑second user portrait queries that previously took minutes, dramatically improving performance and scalability.
Bitmap IndexHologresRoaringBitmap
0 likes · 18 min read

This article explains how ByteHouse leverages a native Bitmap data type and dictionary encoding to accelerate real‑time audience segmentation queries in advertising scenarios, achieving up to 50× performance gains over traditional array‑based models.
Bitmap IndexByteHouseSQL Optimization
0 likes · 10 min read

Mango TV replaced its fragmented EMR‑Hive‑Kudu‑Presto stack with a unified StarRocks lakehouse, simplifying architecture, cutting operational costs, and achieving more than a ten‑fold increase in query speed while supporting real‑time analytics, materialized views, bitmap indexing, and store‑compute separation.
Bitmap IndexStarRocksStore-Compute Separation
0 likes · 14 min read

This article explains how Apache Druid builds and queries bitmap indexes for efficient OLAP analysis, and describes a dictionary‑encoding plus bitmap solution—adapted from Kuaishou—to achieve exact deduplication even on high‑cardinality dimensions.
Bitmap IndexDictionary EncodingDruid
0 likes · 14 min read

This article details Bilibili's lakehouse implementation using Apache Iceberg and Alluxio, covering background challenges, architectural components, data organization techniques like Z‑order and bitmap indexes, performance benchmarks, and future optimization plans for large‑scale analytics.
AlluxioBitmap IndexZ-Order
0 likes · 21 min read

Bilibili’s lakehouse architecture merges Iceberg‑based data lake flexibility with data‑warehouse efficiency, using Kafka‑Flink real‑time ingestion, Spark offline loads, Trino queries, Alluxio caching, Z‑Order/Hilbert sorting, and enhanced BloomFilter and bitmap indexes to boost query speed up to tenfold while drastically cutting file reads.
Bitmap IndexZ-Order sortingbig data architecture
0 likes · 17 min read

Shopee’s engineering team scaled a 100‑node Apache Druid cluster for real‑time OLAP by redesigning the Coordinator load‑balancing algorithm, adding incremental metadata pulls, introducing a segment‑merged result cache, and building exact‑count and flexible sliding‑window operators, while planning cloud‑native deployment.
Apache DruidBitmap IndexCache
0 likes · 17 min read

Baidu’s Short Video Push System is a distributed platform serving hundreds of millions of users across multiple apps, delivering personalized, real‑time notifications via a modular architecture that includes material and user centers, recall, preprocessing, and delivery services, while optimizations such as activity‑based scheduling, bitmap‑based user segmentation, consistent‑hash frequency control, and protobuf compression boost click‑through rates, scalability, and resource efficiency.
BaiduBitmap IndexConsistent Hashing
0 likes · 15 min read

This article shares NetEase’s experience building a user‑profile platform with ClickHouse, detailing the business background, challenges of massive data and complex queries, core table designs, data ingestion, bitmap techniques, performance gains, and future plans for scaling and optimization.
Bitmap IndexClickHouseSQL
0 likes · 13 min read

This article explains how ByteDance leverages ClickHouse for ad audience estimation, profiling, and analytics, detailing the challenges of massive user‑level set operations, the evolution from a simple tag‑uid table to Bitmap64 with RoaringBitmap, and the extensive engineering optimizations that cut query latency, storage, and CPU usage dramatically.
Ad TargetingBitmap IndexClickHouse
0 likes · 22 min read

This article provides an in‑depth analysis of Apache Druid V1’s column‑oriented storage format, covering its dictionary, encoded dimension values, bitmap inverted index, array handling, and how these structures are used during query execution, illustrated with diagrams and code examples.
Apache DruidBitmap IndexColumnar
0 likes · 9 min read

This article provides a detailed analysis of Apache Druid V1's column‑oriented storage format, covering dimension dictionaries, variable‑length encoded values, bitmap inverted indexes, array handling, and the physical metadata layout that enables sub‑second OLAP queries on massive datasets.
Apache DruidBitmap IndexOLAP
0 likes · 8 min read

This article details how ByteDance leverages ClickHouse to power large‑scale advertising audience estimation, profiling, and statistical analysis, describing the challenges of massive data, strict latency requirements, and the evolution from a simple tag‑uid table to a bitmap‑based architecture with extensive parallel and cache optimizations.
Audience EstimationBitmap IndexClickHouse
0 likes · 21 min read

iQIYI upgraded its big‑data stack by adopting Druid as the core engine for free‑time queries and ElasticSearch for pre‑computed fixed‑time queries, overcoming early API, security and scaling challenges through monthly segment granularity, parallel sub‑queries, Redis caching and failover, cutting typical query latency from over two seconds to about 150 ms and reaching 99.9 % service success.
Bitmap IndexElasticsearchdata architecture
0 likes · 12 min read

This article describes how Kuaishou built BitBase on HBase to store and compute billions of user feature logs with millisecond‑level latency, covering business requirements, technical selection, bitmap data modeling, system architecture, device‑ID handling, performance results, and future roadmap.
BitBaseBitmap IndexHBase
0 likes · 11 min read


21CTOJun 11, 2017 · Databases
Pilosa, originally built for sparse high‑cardinality user attributes, is evaluated on a dense, low‑cardinality NYC taxi dataset to see if it can serve as a general‑purpose index, with performance comparisons against Spark, PostgreSQL, Elasticsearch, and kdb+ across multiple query scenarios.
Bitmap IndexNYC Taxi DataPilosa
0 likes · 8 min read

This article examines whether Pilosa, a bitmap index originally built for sparse high‑cardinality data, can efficiently handle dense relational datasets by benchmarking it against a billion‑row NYC taxi trip dataset and comparing query performance with other database systems.
Bitmap IndexNYC taxi datasetPilosa
0 likes · 6 min read
