Author

ByteDance Data Platform

The ByteDance Data Platform team empowers all ByteDance business lines by lowering data‑application barriers, aiming to build data‑driven intelligent enterprises, enable digital transformation across industries, and create greater social value. Internally it supports most ByteDance units; externally it delivers data‑intelligence products under the Volcano Engine brand to enterprise customers.

Articles

Likes

403

Views

Comments

Latest from ByteDance Data Platform

83 recent articles

ByteDance Data Platform

Apr 16, 2025 · Product Management

How A/B Testing Turns Guesswork into Data‑Driven Business Success

In today's fast‑changing market, traditional intuition‑based decisions falter, but systematic A/B testing—illustrated by ByteDance’s academic‑loop culture and real‑world case studies—empowers organizations to replace guesswork with evidence, accelerate innovation, and achieve measurable performance gains across products and strategies.

A/B TestingData-Drivendecision making

0 likes · 18 min read

How A/B Testing Turns Guesswork into Data‑Driven Business Success

ByteDance Data Platform

Feb 12, 2025 · Fundamentals

Why A/B Tests Fail in Recommendation Systems and How to Fix Them

This article examines the hidden complexities of A/B experiments in short‑video recommendation feeds, explains why traditional designs produce biased results due to learning, double‑sided, and network effects, and presents practical double‑sided and community‑randomized experiment frameworks to obtain unbiased strategy evaluations.

A/B TestingCommunity randomizationDouble-sided effects

0 likes · 21 min read

Why A/B Tests Fail in Recommendation Systems and How to Fix Them

ByteDance Data Platform

Jan 9, 2025 · Databases

Why ByteHouse’s GIS Engine Beats Traditional Spatial Databases in Real‑World Analytics

This article explains how ByteHouse integrates high‑performance GIS capabilities into its OLAP engine, describes its spatial indexing architecture, showcases benchmark results against ClickHouse, StarRocks, PostGIS and DuckDB using the NYC Taxi dataset, and outlines when to choose ByteHouse versus other spatial database solutions.

ByteHouseDatabase PerformanceGIS

0 likes · 11 min read

Why ByteHouse’s GIS Engine Beats Traditional Spatial Databases in Real‑World Analytics

ByteDance Data Platform

Nov 27, 2024 · Big Data

Inside Douyin’s Data Asset Platform: Transforming Data Lineage and Governance

Douyin Group’s data asset management platform introduces a systematic "manage, find, use" approach that unifies metadata collection, full‑coverage data lineage, and a suite of applications across development, governance, asset utilization, and security, while outlining its architecture, modeling, quality metrics, and future roadmap.

Data Governancedata lineagemetadata management

0 likes · 14 min read

Inside Douyin’s Data Asset Platform: Transforming Data Lineage and Governance

ByteDance Data Platform

Nov 6, 2024 · Big Data

How Douyin’s Data Platform Overcomes EB‑Scale Metric Challenges

This article explains how Douyin Group tackles massive data volume, quality, and efficiency issues by building a four‑layer intelligent platform, standardizing metric management, automating metric decomposition, and creating reusable metric services that boost agility, stability, and cross‑team collaboration.

Big DataData EngineeringData Quality

0 likes · 20 min read

How Douyin’s Data Platform Overcomes EB‑Scale Metric Challenges

ByteDance Data Platform

Oct 30, 2024 · Big Data

How Volcano Engine’s DataLeap Platform Transforms Data Service Management

Volcano Engine’s DataLeap platform offers a unified API service solution that transforms raw data into reliable, secure data services, featuring full lifecycle management, monitoring, permission control, rate limiting, and visual API orchestration to simplify complex data workflows and improve operational efficiency across big-data scenarios.

API orchestrationBig DataData Service

0 likes · 21 min read

How Volcano Engine’s DataLeap Platform Transforms Data Service Management

ByteDance Data Platform

Oct 16, 2024 · Databases

How ByteHouse Boosted Sales Data Platform Queries Up to 16× with ACL and Optimizer

This article examines a fast‑growing company's sales data platform, outlines the data‑access pain points caused by ACL permissions, describes the migration from ClickHouse to ByteHouse, details the optimizer’s rule‑based, cost‑based, and distributed‑plan enhancements, and presents benchmark results showing query speedups of up to sixteen times.

ACLByteHouseOLAP

0 likes · 16 min read

How ByteHouse Boosted Sales Data Platform Queries Up to 16× with ACL and Optimizer

ByteDance Data Platform

Oct 9, 2024 · Big Data

Douyin’s E‑commerce Tracking Journey: From Log 1.0 to a Unified Attribution Platform

This article examines Douyin Group’s e‑commerce data‑tracking evolution, detailing the transition from early log‑free collection through Log 2.0’s failed overhaul to the streamlined Log 3.0 framework, and explains the resulting SDK, BTM/BCM management, and attribution platform that solve quality, efficiency, and analysis challenges for data engineers.

Log ManagementSDKdata attribution

0 likes · 19 min read

Douyin’s E‑commerce Tracking Journey: From Log 1.0 to a Unified Attribution Platform

ByteDance Data Platform

Sep 25, 2024 · Artificial Intelligence

How LLMs Power the “Find Data Assistant” for Smarter Data Retrieval

This article explains how the Volcano Engine DataLeap team leveraged large‑language models to build the “Find Data Assistant”, detailing its design, challenges, embedding‑and‑reranker enhancements, LLM‑driven semantic search, mixing architecture, and practical lessons for improving data asset management and retrieval.

Data RetrievalEmbeddingLLM

0 likes · 17 min read

How LLMs Power the “Find Data Assistant” for Smarter Data Retrieval

ByteDance Data Platform

Sep 18, 2024 · Big Data

Apache Calcite for Multi‑Engine Metric Management: Practices & Roadmap

This article explains the technical principles and best practices of multi‑engine metric management based on Apache Calcite, covering common metric management methods, implementation details of unified SQL, virtual columns, and SQL defined functions, and outlines ByteDance’s future roadmap for extending these capabilities.

Apache CalciteBig DataSQL Defined Function

0 likes · 16 min read

Apache Calcite for Multi‑Engine Metric Management: Practices & Roadmap