This article explains the motivation for an SQL parser in big‑data ecosystems, describes lexical, syntactic and semantic analysis, compares ANTLR and Apache Calcite as parser solutions, and provides complete code examples and deployment steps for building a functional SQL parsing engine.
The article explains why adding a SQL parser to big‑data platforms such as Hive, Spark, Flink or Kafka simplifies development, compares ANTLR and Apache Calcite implementations, shows code examples, and concludes that Calcite’s lower learning curve and greater flexibility make it the preferred choice for production‑grade SQL layers.
This article explains how Cobar’s SQL parser converts SQL statements into an abstract syntax tree (AST), details the parser’s implementation options, demonstrates AST node definitions and visitor‑based traversal in Java, and explores practical applications such as sharding, feature extraction, and dangerous‑SQL interception.
This article explains how to use the TiDB SQL parser to create custom SQL fingerprints by traversing the abstract syntax tree, replacing literal values with placeholders, and restoring the modified tree back to SQL, offering a more maintainable alternative to string‑based approaches.
In 2020 I joined Alibaba's ASoC program, explored Seata's Druid‑based SQL parser, replaced it with an Antlr‑generated solution, tackled spacing bugs by overriding visitTerminal, and reflected on the open‑source contribution experience that enhanced Seata's distributed‑transaction capabilities.
This article provides an in‑depth technical overview of Alibaba's AnalyticDB, covering the challenges of massive real‑time analytics, the cloud‑native multi‑tenant architecture, data model, import/export capabilities, high‑performance SQL parser, the Xuanwu storage engine, Xihe compute engine, optimizer, GPU acceleration, and elastic scaling features.
