Can Pilosa Handle Dense Relational Data? A Deep Dive with NYC Taxi Dataset

Pilosa, originally built for sparse high‑cardinality user attributes, is evaluated on a dense, low‑cardinality NYC taxi dataset to see if it can serve as a general‑purpose index, with performance comparisons against Spark, PostgreSQL, Elasticsearch, and kdb+ across multiple query scenarios.

Bitmap IndexNYC Taxi DataPilosa

0 likes · 8 min read

Can Pilosa Handle Dense Relational Data? A Deep Dive with NYC Taxi Dataset

High Availability Architecture

Jun 7, 2017 · Databases

Evaluating Pilosa on Dense, Low‑Cardinality Data Using the NYC Taxi Dataset

This article examines whether Pilosa, a bitmap index originally built for sparse high‑cardinality data, can efficiently handle dense relational datasets by benchmarking it against a billion‑row NYC taxi trip dataset and comparing query performance with other database systems.

Bitmap IndexNYC taxi datasetPilosa

0 likes · 6 min read

Evaluating Pilosa on Dense, Low‑Cardinality Data Using the NYC Taxi Dataset