Tag

Query Optimizer

0 views collected around this technical thread.

Efficient Ops
Efficient Ops
Jun 3, 2024 · Databases

How Does MySQL Execute a Query? Inside the Server Architecture

This article walks through how MySQL processes a SELECT query, detailing the server and storage engine layers, the roles of the connector, query cache, parser, optimizer, and executor, and provides practical command‑line examples to illustrate each step.

ConnectorDatabase ArchitectureExecutor
0 likes · 11 min read
How Does MySQL Execute a Query? Inside the Server Architecture
Top Architecture Tech Stack
Top Architecture Tech Stack
Nov 5, 2023 · Databases

Understanding MySQL Communication Protocols, Parsing, Optimizer, Storage Engines, and Execution Engine

This article explains how MySQL establishes connections, the supported communication protocols and message formats, the lexical and syntactic parsing process, query optimization and execution plan generation, the role of different storage engines, and how the execution engine uses the plan to operate on the storage layer.

Execution EngineMySQLQuery Optimizer
0 likes · 15 min read
Understanding MySQL Communication Protocols, Parsing, Optimizer, Storage Engines, and Execution Engine
DataFunTalk
DataFunTalk
Sep 24, 2023 · Databases

Insights into the Design and Challenges of Doris' New Optimizer (Nereids)

The article explains why Doris needed a new optimizer, describes its architecture—including rule‑based and cost‑based stages, early data‑size reduction techniques, dynamic‑programming join‑reorder methods, and practical challenges such as statistics errors and runtime filters—while sharing performance results and a Q&A session.

Cost-Based OptimizationDorisJoin Reorder
0 likes · 17 min read
Insights into the Design and Challenges of Doris' New Optimizer (Nereids)
DataFunTalk
DataFunTalk
Aug 15, 2023 · Databases

Apache Doris 2.0.0 Release Highlights and New Features

Apache Doris 2.0.0, released on August 11, 2023, introduces a new Cascades‑based optimizer, inverted index, point‑query acceleration, pipeline execution engine, multi‑tenant resource isolation, cloud‑native compute nodes, and extensive performance gains of up to ten‑fold in benchmark queries and dozens of times in real‑world workloads.

Apache DorisDatabase ReleasePerformance Boost
0 likes · 24 min read
Apache Doris 2.0.0 Release Highlights and New Features
Architect's Guide
Architect's Guide
Jan 7, 2023 · Databases

MySQL Execution Process Overview

This article explains the complete MySQL execution flow, covering the connector, permission verification, caching, parser, optimizer, executor, process states, SQL execution order, and the impact of WHERE‑clause condition ordering on query performance.

Execution ProcessMySQLPermissions
0 likes · 13 min read
MySQL Execution Process Overview
DataFunTalk
DataFunTalk
Oct 25, 2022 · Databases

Design and Implementation of ByteHouse Query Optimizer

The article explains how ByteHouse extends ClickHouse with a full‑featured query optimizer—including rule‑based and cost‑based techniques, analyzer modules, plan construction, and distributed optimization—to overcome ClickHouse limitations and achieve significant performance gains on complex OLAP workloads.

ByteHouseCBODistributed Query
0 likes · 10 min read
Design and Implementation of ByteHouse Query Optimizer
Big Data Technology Architecture
Big Data Technology Architecture
Aug 5, 2022 · Databases

In-Depth Analysis of StarRocks Optimizer Architecture and Techniques

This article provides a comprehensive technical overview of StarRocks' query optimizer, covering its cascades/ORCA-inspired architecture, logical and physical plan transformations, cost modeling, statistics derivation, memo structure, task scheduling, and practical examples of join optimization in a distributed OLAP engine.

CascadesDatabaseOLAP
0 likes · 14 min read
In-Depth Analysis of StarRocks Optimizer Architecture and Techniques
DataFunTalk
DataFunTalk
Jul 6, 2022 · Databases

From ClickHouse to ByteHouse: Technical Optimizations and Production Practices

The whitepaper “From ClickHouse to ByteHouse” details ByteDance’s large‑scale deployment of ClickHouse, the challenges of moving it to production, and the key optimizations ByteHouse introduces—including custom table engines, a revamped query optimizer, and elastic compute‑storage separation—to achieve petabyte‑level OLAP performance.

Analytical DatabasesByteHouseClickHouse
0 likes · 6 min read
From ClickHouse to ByteHouse: Technical Optimizations and Production Practices
Top Architect
Top Architect
Jun 14, 2022 · Databases

Understanding MySQL Execution Process: Connectors, Cache, Parser, Optimizer, and Executor

This article explains MySQL's internal execution process—including the connector, cache, parser, optimizer, and executor—describes privilege tables and verification, discusses query caching removal, outlines logical SQL execution order, and provides practical tips for ordering WHERE conditions to improve performance.

DatabaseDatabase InternalsMySQL
0 likes · 12 min read
Understanding MySQL Execution Process: Connectors, Cache, Parser, Optimizer, and Executor
Qunar Tech Salon
Qunar Tech Salon
Aug 3, 2021 · Databases

Deep Dive into MySQL 8.0 Server Architecture, Parser, and Optimizer

This article analyzes MySQL 8.0.25 source code, detailing the server architecture, parser reconstruction, prepare/rewrite stages, the optimizer transformations, and the new hypergraph optimizer, while also comparing these mechanisms with PostgreSQL’s processing pipeline.

Database InternalsHypergraphMySQL
0 likes · 12 min read
Deep Dive into MySQL 8.0 Server Architecture, Parser, and Optimizer
Tencent Database Technology
Tencent Database Technology
May 31, 2021 · Databases

TXSQL Query Optimizer Framework: Transformation, Join Reorder, and Cost Model

This article introduces the TXSQL query optimizer built on MySQL 8.0.22, detailing its cascades‑style framework, transformation rewrite rules such as outer‑join elimination and subquery flattening, join‑order heuristics, cost‑model configuration, and execution strategies, providing a comprehensive overview of its design and enhancements.

DatabaseJoin ReorderMySQL
0 likes · 25 min read
TXSQL Query Optimizer Framework: Transformation, Join Reorder, and Cost Model
Big Data Technology Architecture
Big Data Technology Architecture
Sep 30, 2020 · Databases

Core Technologies of OLAP Systems: Storage, Computation, Optimizer, and Emerging Trends

This article systematically examines the core technologies of OLAP systems, covering storage models, columnar formats, indexing, distributed storage architectures, query execution steps, optimizer designs, and emerging trends such as real‑time analytics, HTAP, cloud‑native deployment, and hardware acceleration.

Big DataOLAPQuery Optimizer
0 likes · 23 min read
Core Technologies of OLAP Systems: Storage, Computation, Optimizer, and Emerging Trends
Aikesheng Open Source Community
Aikesheng Open Source Community
May 13, 2019 · Databases

Understanding Cardinality and HINT Usage in MySQL Query Optimization

This article explains the concepts of cardinality and HINT in MySQL, demonstrates how inaccurate cardinality can lead to sub‑optimal execution plans, and shows how applying index_merge hints dramatically reduces query cost and row scans for multi‑column predicates.

CardinalityMySQLQuery Optimizer
0 likes · 7 min read
Understanding Cardinality and HINT Usage in MySQL Query Optimization