Tagged articles

8 articles

Page 1 of 1

Sep 18, 2024 · Big Data

Apache Calcite for Multi‑Engine Metric Management: Practices & Roadmap

This article explains the technical principles and best practices of multi‑engine metric management based on Apache Calcite, covering common metric management methods, implementation details of unified SQL, virtual columns, and SQL defined functions, and outlines ByteDance’s future roadmap for extending these capabilities.

Apache CalciteBig DataSQL Defined Function

0 likes · 16 min read

Apache Calcite for Multi‑Engine Metric Management: Practices & Roadmap

DataFunSummit

May 10, 2023 · Big Data

Field-Level Data Lineage Extraction for FlinkSQL Using Apache Calcite

This article explains how to derive field‑level data lineage for FlinkSQL by leveraging Apache Calcite, covering the Calcite framework, FlinkSQL execution stages, the three‑step parsing approach, core source code details, practical Insert/Join examples, and extensions for lookup joins and UDTFs.

Apache CalciteData LineageFlinkSQL

0 likes · 12 min read

Field-Level Data Lineage Extraction for FlinkSQL Using Apache Calcite

ByteDance Cloud Native

Feb 17, 2023 · Big Data

From First PR to PMC: My Journey Contributing to Apache Calcite

ByteDance engineer Li Benchao shares his ten‑month evolution from a curious newcomer to a PMC member of Apache Calcite, describing how his work on Flink SQL led to deep involvement in the open‑source community, technical growth, and mentorship.

Apache CalciteApache FlinkSQL Optimization

0 likes · 8 min read

From First PR to PMC: My Journey Contributing to Apache Calcite

Big Data Technology & Architecture

Sep 22, 2022 · Databases

Apache Calcite Overview: Architecture, SQL Processing Flow, and Practical Example

This article introduces Apache Calcite as a modular data‑management framework, explains its architecture and SQL processing pipeline—from parsing and validation to relational‑algebra conversion, optimization, and execution—and demonstrates a complete CSV‑based query example with code snippets.

Apache CalciteJavaRelNode

0 likes · 13 min read

Apache Calcite Overview: Architecture, SQL Processing Flow, and Practical Example

Big Data Technology & Architecture

Aug 2, 2022 · Big Data

Understanding Apache Calcite: Architecture, SQL Parsing, Validation, and Query Optimization

This article provides a comprehensive overview of Apache Calcite, covering its purpose as a pluggable query processing framework for heterogeneous data sources, its core components such as the SQL parser, catalog, validator, and optimizer, and practical extension scenarios for big‑data engines.

Apache Calcitemetadata catalog

0 likes · 16 min read

Understanding Apache Calcite: Architecture, SQL Parsing, Validation, and Query Optimization

Laravel Tech Community

Aug 24, 2020 · Backend Development

Apache Calcite 1.25.0 Released with Spatial Functions and SQL Interval Support

Apache Calcite 1.25.0, a dynamic data management framework for Hadoop, has been released, introducing support for spatial functions and SQL interval expressions, removing deprecated methods from the previous version, and providing updated Maven dependency coordinates for the core library.

Apache CalciteData ManagementHadoop

0 likes · 2 min read

Apache Calcite 1.25.0 Released with Spatial Functions and SQL Interval Support

360 Tech Engineering

Aug 27, 2019 · Databases

Quicksql: A Unified Cross‑Data‑Source SQL Query Engine

Quicksql is an open‑source, cross‑data‑source SQL engine built on Apache Calcite that provides a unified, safe, and fast SQL interface, enabling users to query heterogeneous storage systems such as Hive, MySQL, Elasticsearch, and Druid through command‑line, API, or JDBC connections.

Apache CalciteData IntegrationUnified Query Engine

0 likes · 6 min read

Quicksql: A Unified Cross‑Data‑Source SQL Query Engine

360 Tech Engineering

Aug 27, 2019 · Big Data

Design and Practice of 360’s Multi‑Data‑Source Unified SQL Query Engine

The article presents 360’s challenges with heterogeneous, high‑volume data sources, explains the design of a unified federated SQL engine called QuickSQL that leverages Apache Calcite, Spark, Flink and other back‑ends, and evaluates its performance and future development directions.

Apache CalciteData Integrationfederated query

0 likes · 10 min read

Design and Practice of 360’s Multi‑Data‑Source Unified SQL Query Engine