Tag

cost model

0 views collected around this technical thread.

Lobster Programming
Lobster Programming
Oct 5, 2024 · Databases

How MySQL Chooses the Cheapest Execution Plan: Cost Model Explained

This article explains MySQL's layered architecture, how the optimizer generates multiple execution plans, evaluates their I/O and engine costs, and selects the plan with the lowest total cost, illustrated with example queries, cost tables, and JSON output.

MySQLSQLcost model
0 likes · 9 min read
How MySQL Chooses the Cheapest Execution Plan: Cost Model Explained
DataFunSummit
DataFunSummit
Aug 11, 2024 · Cloud Native

Optimizing I/O for Data‑Intensive Analytics in Cloud‑Native Environments: Insights from Uber Presto

This whitepaper examines the industry trend of moving data‑intensive analytics workloads to cloud‑native platforms, revealing how cloud storage cost models affect performance optimization, and presents case‑study findings from Uber’s Presto production environment that highlight fragmented I/O patterns and the financial impact of storage API calls.

Big DataCloud NativeI/O optimization
0 likes · 3 min read
Optimizing I/O for Data‑Intensive Analytics in Cloud‑Native Environments: Insights from Uber Presto
DataFunTalk
DataFunTalk
Aug 11, 2024 · Cloud Native

Optimizing I/O for Data‑Intensive Analytics in Cloud‑Native Environments: Insights from Uber Presto

This whitepaper examines the industry trend of moving data‑intensive analytics workloads to cloud‑native environments, revealing how cloud storage cost models affect I/O optimization, and presents Uber Presto case‑study findings that highlight fragmented access patterns and financial implications of storage API calls.

Big DataCloud NativeI/O optimization
0 likes · 3 min read
Optimizing I/O for Data‑Intensive Analytics in Cloud‑Native Environments: Insights from Uber Presto
DataFunSummit
DataFunSummit
Aug 10, 2024 · Cloud Native

Optimizing I/O for Data‑Intensive Analytics in Cloud‑Native Environments: Insights from Uber Presto

This whitepaper investigates the migration of data‑intensive analytics to cloud‑native environments, using Uber’s Presto workload to expose how cloud storage cost models and fragmented I/O patterns affect performance, and proposes optimized I/O strategies to improve cost‑effectiveness and system design.

Case StudyCloud NativeData Analytics
0 likes · 3 min read
Optimizing I/O for Data‑Intensive Analytics in Cloud‑Native Environments: Insights from Uber Presto
DataFunTalk
DataFunTalk
Aug 10, 2024 · Cloud Native

Optimizing I/O for Data‑Intensive Analytics in Cloud‑Native Environments: Insights from Uber Presto

This whitepaper examines the industry trend of moving data‑intensive analytics workloads to cloud‑native environments, analyzes the unique cost model of cloud storage, and presents case‑study findings from Uber’s Presto production system that reveal fragmented I/O patterns and propose optimization strategies to improve cost‑performance in the cloud.

Big DataCloud NativeData Analytics
0 likes · 3 min read
Optimizing I/O for Data‑Intensive Analytics in Cloud‑Native Environments: Insights from Uber Presto
DataFunTalk
DataFunTalk
Aug 2, 2024 · Cloud Native

Optimizing I/O for Data‑Intensive Analytics in Cloud‑Native Environments: Insights from Uber’s Presto Deployment

This whitepaper examines the trend of moving data‑intensive analytics workloads to cloud‑native platforms, revealing how cloud storage cost models affect I/O optimization, and using Uber’s Presto production data to show that traditional I/O strategies overlook costly storage API calls, leading to high expenses.

Case StudyCloud NativeI/O optimization
0 likes · 3 min read
Optimizing I/O for Data‑Intensive Analytics in Cloud‑Native Environments: Insights from Uber’s Presto Deployment
DataFunSummit
DataFunSummit
Jul 27, 2024 · Cloud Native

Migrating Data‑Intensive Analytics to Cloud‑Native Environments: Cost‑Aware I/O Optimization Insights from Uber Presto

This whitepaper examines the industry trend of moving data‑intensive analytics workloads to cloud‑native platforms, revealing how cloud storage’s unique cost model demands finer‑grained I/O optimization, illustrated through an empirical case study of Uber’s Presto production environment and its fragmented access patterns.

Case StudyCloud NativeData Analytics
0 likes · 3 min read
Migrating Data‑Intensive Analytics to Cloud‑Native Environments: Cost‑Aware I/O Optimization Insights from Uber Presto
DataFunSummit
DataFunSummit
Jul 26, 2024 · Cloud Native

Optimizing I/O for Data‑Intensive Analytics in Cloud‑Native Environments: A Case Study of Uber Presto

This whitepaper examines the industry trend of moving data‑intensive analytics workloads to cloud‑native platforms, analyzing how cloud storage cost models affect performance optimization, and presents a case study of Uber’s Presto production environment that reveals fragmented I/O patterns and the financial impact of storage API calls.

Big DataCloud NativeI/O optimization
0 likes · 3 min read
Optimizing I/O for Data‑Intensive Analytics in Cloud‑Native Environments: A Case Study of Uber Presto
DataFunTalk
DataFunTalk
Jul 26, 2024 · Cloud Native

Optimizing I/O for Data‑Intensive Analytics in Cloud‑Native Environments: Insights from Uber Presto

This whitepaper examines the industry trend of moving data‑intensive analytics workloads to cloud‑native environments, analyzes how cloud storage cost models affect performance optimization, and presents Uber Presto case‑study findings that reveal fragmented access patterns and hidden financial costs of traditional I/O strategies.

Big DataCase StudyCloud Native
0 likes · 3 min read
Optimizing I/O for Data‑Intensive Analytics in Cloud‑Native Environments: Insights from Uber Presto
DataFunTalk
DataFunTalk
Jul 21, 2024 · Cloud Native

Optimizing I/O for Data-Intensive Applications in Cloud-Native Environments: Insights from Uber Presto

This whitepaper examines the industry shift of moving data‑intensive analytics to cloud‑native platforms, revealing how cloud storage’s unique cost model demands nuanced I/O optimization, and presents Uber Presto case‑study findings that highlight fragmented access patterns and cost‑effective design strategies for high‑performance cloud workloads.

Big DataCloud NativeI/O optimization
0 likes · 3 min read
Optimizing I/O for Data-Intensive Applications in Cloud-Native Environments: Insights from Uber Presto
DataFunSummit
DataFunSummit
Jun 22, 2024 · Cloud Native

Optimizing I/O for Data-Intensive Analytics in Cloud-Native Environments: Insights from Uber Presto

This whitepaper examines the industry trend of migrating data‑intensive analytics workloads to cloud‑native environments, revealing how cloud storage’s unique cost model demands finer‑grained performance optimization, and presents Uber Presto case‑study findings that expose fragmented I/O patterns and associated financial impacts.

Cloud NativeData AnalyticsI/O optimization
0 likes · 3 min read
Optimizing I/O for Data-Intensive Analytics in Cloud-Native Environments: Insights from Uber Presto
DataFunSummit
DataFunSummit
Jun 9, 2024 · Cloud Native

Optimizing I/O for Data‑Intensive Analytics in Cloud‑Native Environments: Insights from Uber Presto

This whitepaper examines the industry trend of moving data‑intensive analytics workloads to cloud‑native platforms, analyzes how cloud storage cost models affect performance optimization, and presents a case study of Uber's Presto deployment that reveals fragmented access patterns and new I/O cost considerations.

Big DataCase StudyCloud Native
0 likes · 3 min read
Optimizing I/O for Data‑Intensive Analytics in Cloud‑Native Environments: Insights from Uber Presto
DataFunTalk
DataFunTalk
Jun 9, 2024 · Cloud Native

Optimizing I/O for Data‑Intensive Analytics in Cloud‑Native Environments: Insights from Uber Presto

This whitepaper examines the industry trend of moving data‑intensive analytics workloads to cloud‑native platforms, analyzes how cloud storage cost models affect performance optimization, and presents Uber Presto case‑study findings that reveal fragmented access patterns and new I/O strategies to improve cost‑effectiveness.

Case StudyCloud NativeI/O optimization
0 likes · 3 min read
Optimizing I/O for Data‑Intensive Analytics in Cloud‑Native Environments: Insights from Uber Presto
DataFunSummit
DataFunSummit
Jun 8, 2024 · Cloud Native

Optimizing I/O for Data‑Intensive Analytics in Cloud‑Native Environments: Insights from Uber Presto

This whitepaper examines the industry shift of moving data‑intensive analytics to cloud‑native platforms, analyzes how cloud storage cost models affect performance optimization, and presents Uber Presto case‑study findings that reveal fragmented access patterns and the financial impact of traditional I/O strategies in the cloud.

Big DataCloud NativeData Analytics
0 likes · 3 min read
Optimizing I/O for Data‑Intensive Analytics in Cloud‑Native Environments: Insights from Uber Presto
DataFunSummit
DataFunSummit
Jun 6, 2024 · Cloud Native

Optimizing I/O for Data‑Intensive Analytics in Cloud‑Native Environments: Insights from Uber Presto

This whitepaper examines the industry trend of moving data‑intensive analytics workloads to cloud‑native platforms, analyzes the unique cost model of cloud storage, and presents case‑study findings from Uber's Presto production environment to guide efficient I/O design and cost‑effective performance optimization.

Cloud NativeI/O optimizationPerformance
0 likes · 3 min read
Optimizing I/O for Data‑Intensive Analytics in Cloud‑Native Environments: Insights from Uber Presto
DataFunSummit
DataFunSummit
Jun 5, 2024 · Cloud Native

Migrating Data‑Intensive Analytics to Cloud‑Native Environments: Cost‑Aware I/O Optimization Insights from Uber Presto

This whitepaper examines the industry trend of moving data‑intensive analytics workloads to cloud‑native platforms, revealing how cloud storage cost models affect performance optimization and presenting case‑study‑based I/O strategies derived from Uber's Presto production environment.

Big DataCase StudyCloud Native
0 likes · 3 min read
Migrating Data‑Intensive Analytics to Cloud‑Native Environments: Cost‑Aware I/O Optimization Insights from Uber Presto
JD Retail Technology
JD Retail Technology
May 8, 2024 · Databases

Understanding MySQL Cost Model for Index Optimization and Conflict Resolution

This article explains MySQL's cost‑based optimizer, demonstrates how to calculate query costs for full‑table, covering, ref and range scans using actual source‑code constants, and applies the model to resolve index‑conflict cases in a store‑goods table, offering practical optimization guidelines and future tool ideas.

Index OptimizationMySQLQuery Planning
0 likes · 22 min read
Understanding MySQL Cost Model for Index Optimization and Conflict Resolution
Baidu Geek Talk
Baidu Geek Talk
Mar 21, 2023 · Artificial Intelligence

Infrastructure Challenges and Solutions for Large‑Scale AI Model Training

The article explains how the massive compute and storage demands of today’s large language models create a “compute wall” and “storage wall,” and describes Baidu Intelligent Cloud’s four‑layer full‑stack infrastructure—combining advanced parallelism techniques, optimized GPU networking, static‑graph compilation, and cost‑model‑driven placement—to train trillion‑parameter models efficiently.

AI infrastructureGPU clusterscost model
0 likes · 27 min read
Infrastructure Challenges and Solutions for Large‑Scale AI Model Training
Aikesheng Open Source Community
Aikesheng Open Source Community
Nov 30, 2022 · Databases

Understanding Index Condition Pushdown (ICP) in MySQL and Its Impact on Query Cost

Index Condition Pushdown (ICP) in MySQL pushes filter conditions to the storage engine to reduce row lookups, but this article demonstrates through experiments that while ICP lowers runtime by decreasing back‑table accesses, the optimizer’s cost model often ignores its benefits, leading to suboptimal plan choices.

DatabaseIndex Condition PushdownMySQL
0 likes · 10 min read
Understanding Index Condition Pushdown (ICP) in MySQL and Its Impact on Query Cost
Big Data Technology Architecture
Big Data Technology Architecture
Aug 5, 2022 · Databases

In-Depth Analysis of StarRocks Optimizer Architecture and Techniques

This article provides a comprehensive technical overview of StarRocks' query optimizer, covering its cascades/ORCA-inspired architecture, logical and physical plan transformations, cost modeling, statistics derivation, memo structure, task scheduling, and practical examples of join optimization in a distributed OLAP engine.

CascadesDatabaseOLAP
0 likes · 14 min read
In-Depth Analysis of StarRocks Optimizer Architecture and Techniques