BestHub
Sign in
Tagged articles
370 articles
Page 3 of 4
Architects Research Society
Architects Research Society
Jun 30, 2022 · Big Data

Beyond Monolithic Data Lakes: Embracing a Distributed Data Mesh Architecture

The article examines why traditional centralized data lake architectures fail at scale, outlines common failure patterns, and proposes a paradigm shift toward a distributed data mesh that treats domain‑oriented data as a product, leverages self‑service platforms, and aligns engineering, product, and governance practices for modern enterprise data platforms.

Data MeshData PlatformData Product
0 likes · 33 min read
Beyond Monolithic Data Lakes: Embracing a Distributed Data Mesh Architecture
DataFunTalk
DataFunTalk
Jun 29, 2022 · Big Data

Migrating a Game Data Platform to StarRocks: Architecture, Performance Gains, and Operational Benefits

This article describes how the gaming company Boke City rebuilt its comprehensive data service platform by replacing a CDH‑based Impala solution with StarRocks, detailing the architectural changes, performance benchmark results, and the resulting improvements in query speed, real‑time data updates, and operational simplicity.

Big DataData PlatformGame Analytics
0 likes · 14 min read
Migrating a Game Data Platform to StarRocks: Architecture, Performance Gains, and Operational Benefits
phodal
phodal
Jun 26, 2022 · Industry Insights

How Can Architecture Governance Become Self‑Service and Continuous?

This article explores the concept of architecture autonomous services as a self‑service data platform for architecture governance, outlines a four‑stage roadmap, provides concrete Log4j tracking examples using SourceGraph and ArchGuard, and details practical steps to build a data foundation, abstract service interfaces, integrate BI, and design metric‑driven evolution.

Data Platformarchitecture governancelog4j tracking
0 likes · 10 min read
How Can Architecture Governance Become Self‑Service and Continuous?
dbaplus Community
dbaplus Community
Jun 14, 2022 · Big Data

How Qunar Built a Scalable BI Platform for Real‑Time Analytics and Self‑Service Reporting

This article details Qunar's multi‑year journey of designing and evolving a full‑stack BI platform—covering data ingestion, storage, query engines, self‑service analytics, and real‑time OLAP—by iterating through three development phases, selecting technologies such as Impala, Kudu, ClickHouse and Apache Druid, and addressing performance, usability and governance challenges to empower business users with fast, reliable data insights.

Apache DruidBIBig Data
0 likes · 24 min read
How Qunar Built a Scalable BI Platform for Real‑Time Analytics and Self‑Service Reporting
JD Retail Technology
JD Retail Technology
Jun 10, 2022 · Big Data

Design and Implementation of an International Business Data Platform for JD.com's 618 Promotion

The article details JD International's challenges and solutions in building a unified, real‑time data platform for its multi‑regional 618 promotion, covering business characteristics, data distribution, team organization, dashboard architecture, integration strategies, and short‑ and long‑term technical plans.

Data IntegrationData PlatformFlink
0 likes · 8 min read
Design and Implementation of an International Business Data Platform for JD.com's 618 Promotion
DataFunTalk
DataFunTalk
Jun 5, 2022 · Big Data

JD Big Data Platform: Cross‑Region and Tiered Storage Architecture and Practices

This article presents JD's large‑scale big‑data platform, detailing its overall architecture, the challenges of cross‑region storage, the design of a unified cross‑domain data synchronization mechanism, and the implementation of tiered storage to improve performance, cost efficiency, and data reliability across multi‑datacenter clusters.

Big DataData PlatformHDFS
0 likes · 15 min read
JD Big Data Platform: Cross‑Region and Tiered Storage Architecture and Practices
DataFunSummit
DataFunSummit
May 29, 2022 · Big Data

OPPO Commercial Data System Construction Practice: Platform, Ingestion, Development, Governance, and Analytics

This article presents OPPO's commercial data system construction practice, covering the data platform strategy, ingestion pipelines, development efficiency toolkits, data validation, visualization aids, UDF principles, warehouse architecture, metric systems, dimensional modeling, ETL optimization, governance metadata, quality management, monitoring, attribution services, analytics reporting, and a Q&A session.

AnalyticsData Platformdata engineering
0 likes · 17 min read
OPPO Commercial Data System Construction Practice: Platform, Ingestion, Development, Governance, and Analytics
Bilibili Tech
Bilibili Tech
May 24, 2022 · Big Data

Metadata Infrastructure and Governance in Bilibili Data Platform

Bilibili’s data platform consolidates scattered metadata into a unified URN‑based model stored across TiDB, Elasticsearch, and HugeGraph, offering batch‑pull and embedded collection, flexible SQL‑like queries, comprehensive lineage mapping, and powering data‑map, lineage‑map, and impact‑analysis tools while planning expanded quality assurance and self‑service dictionaries.

Data GovernanceData LineageData Platform
0 likes · 21 min read
Metadata Infrastructure and Governance in Bilibili Data Platform
Architecture Digest
Architecture Digest
May 23, 2022 · Big Data

Overview of Core Technologies in a Big Data Platform Architecture

This article explains the main layers of a typical big data platform—data collection, storage and analysis, sharing, and application—detailing common tools such as Flume, DataX, Hive, Spark, SparkSQL, Impala, and Spark Streaming, and discusses task scheduling and monitoring in the ecosystem.

Data PlatformDataXHadoop
0 likes · 10 min read
Overview of Core Technologies in a Big Data Platform Architecture
DaTaobao Tech
DaTaobao Tech
May 13, 2022 · Big Data

Taobao Big Data Model Governance and DataWorks Co‑development

Taobao’s rapidly expanding technical data system faced naming inconsistencies, low table reuse, and costly, inefficient data usage, prompting a joint effort with DataWorks to digitize model evaluation, enforce standardized governance, deliver intelligent end‑to‑end modeling tools, and launch a development assistant, resulting in a health‑monitoring dashboard, upgraded data maps, and a roadmap for further automation and architecture refinement.

Big DataData GovernanceData Platform
0 likes · 12 min read
Taobao Big Data Model Governance and DataWorks Co‑development
Big Data Technology Architecture
Big Data Technology Architecture
Apr 29, 2022 · Big Data

Halodoc’s Data Platform Evolution: From Redshift to a LakeHouse Architecture with Apache Hudi

This article describes how Halodoc’s data engineering team identified limitations of their Redshift‑based platform, evaluated a LakeHouse design, selected Apache Hudi for mutable data handling, and outlined the challenges and benefits of building a scalable, decoupled storage‑compute architecture for their growing healthcare services.

Apache HudiData Platformdata engineering
0 likes · 9 min read
Halodoc’s Data Platform Evolution: From Redshift to a LakeHouse Architecture with Apache Hudi
Architects Research Society
Architects Research Society
Apr 6, 2022 · Big Data

Why Enterprise Data Architects Should Build Distributed Data Meshes Instead of Centralized Data Platforms

Zhamak Dehghani argues that enterprise data architects should replace centralized data warehouses and lakes with a distributed data mesh that leverages domain‑owned data products, addressing scalability, coupling, and ownership failures through a paradigm shift toward self‑serve, discoverable, and interoperable data components.

Data MeshData Platformdistributed architecture
0 likes · 7 min read
Why Enterprise Data Architects Should Build Distributed Data Meshes Instead of Centralized Data Platforms
DataFunTalk
DataFunTalk
Apr 4, 2022 · Big Data

Impala Deployment and Optimization in Sensors Data's Multi-Dimensional Analytics Platform

This article details the architecture of Sensors Data's analytics platform, the implementation of a real‑time Impala query engine, multiple query‑performance optimizations—including storage redesign, user‑behavior sequence tuning, join elimination and expression push‑down—and a resource‑estimation framework that dramatically reduces query failures and latency.

Big DataData PlatformImpala
0 likes · 16 min read
Impala Deployment and Optimization in Sensors Data's Multi-Dimensional Analytics Platform
dbaplus Community
dbaplus Community
Mar 22, 2022 · Operations

How Meituan Scales Kafka to 7,500 Nodes: Real-World Optimizations and Lessons

Meituan’s data platform runs Kafka on over 7,500 machines, handling daily traffic exceeding 21 PB, and tackles latency, slow nodes, and massive cluster management through layered optimizations—including disk balancing, pipeline acceleration, fetcher isolation, cgroup isolation, SSD caching, isolation strategies, full‑link monitoring, lifecycle management, and TOR disaster recovery.

Data PlatformKafkaLarge-scale systems
0 likes · 23 min read
How Meituan Scales Kafka to 7,500 Nodes: Real-World Optimizations and Lessons
DataFunSummit
DataFunSummit
Mar 5, 2022 · Big Data

Fundamentals of Data Middle Platform: Logic, Principles, and Practices

This article explains the concept, necessity, principles, and practical implementation of a data middle platform, outlining its methodology, organizational structure, technical architecture, and the challenges it solves such as inconsistent metrics, data duplication, low query efficiency, poor quality, and high construction costs.

Data Middle PlatformData Platform
0 likes · 13 min read
Fundamentals of Data Middle Platform: Logic, Principles, and Practices
Kuaishou Big Data
Kuaishou Big Data
Mar 3, 2022 · Big Data

How Kwai’s OneService Platform Revolutionizes Data Service Development

The article details Kwai’s OneService platform—a low‑code, self‑service data platform that streamlines API creation, deployment, and operation, covering its background, architecture, key technologies such as API matrix and configuration‑as‑code, high‑availability and performance strategies, achieved results, and future roadmap.

API ServiceData PlatformPerformance Optimization
0 likes · 20 min read
How Kwai’s OneService Platform Revolutionizes Data Service Development
DataFunTalk
DataFunTalk
Mar 3, 2022 · Big Data

Youzan Data Platform and DP Data Development Platform: Architecture, Core Modules, and Scheduling System Upgrade

This article presents an in‑depth overview of Youzan's data platform, introduces the DP data development platform with its key features and workflow, details the core module architecture—including service, scheduling, and component layers—and explains the migration from Airflow to DolphinScheduler to improve performance, stability, and scalability.

Big DataData DevelopmentData Platform
0 likes · 14 min read
Youzan Data Platform and DP Data Development Platform: Architecture, Core Modules, and Scheduling System Upgrade
DataFunTalk
DataFunTalk
Feb 23, 2022 · Big Data

NetEase Data Platform DataOps Practices for Improving Data Quality

This article details how NetEase's DataFunTalk presentation explores the growing data quality challenges in data development and demonstrates the application of DataOps principles—including pre‑ and post‑control mechanisms, sandbox environments, and automated governance tools—to systematically reduce defects, optimize resources, and ensure reliable data delivery across the company's diverse business lines.

Big DataData PlatformDataOps
0 likes · 14 min read
NetEase Data Platform DataOps Practices for Improving Data Quality
DataFunTalk
DataFunTalk
Feb 19, 2022 · Big Data

Fundamentals of Data Middle Platform: Logic, Principles, and Practice

This article explains what a data middle platform is, why organizations need it, its core principles, technical architecture, and practical implementation guidelines, highlighting how it solves issues like inconsistent metrics, duplicate data construction, low query efficiency, poor data quality, and high development costs.

Big DataData ArchitectureData Middle Platform
0 likes · 14 min read
Fundamentals of Data Middle Platform: Logic, Principles, and Practice
Ctrip Technology
Ctrip Technology
Feb 17, 2022 · Databases

Building a Hotel Information Graph with Nebula Graph at Ctrip: Architecture, Challenges, and Solutions

This article details how Ctrip’s hotel tech team built an information‑graph platform using Nebula Graph to link user scenarios with hotel data, addressing challenges of scene‑information mapping, data richness, and operational efficiency through a unified backend architecture, deployment strategies, and schema design.

Backend ArchitectureData PlatformNebula Graph
0 likes · 21 min read
Building a Hotel Information Graph with Nebula Graph at Ctrip: Architecture, Challenges, and Solutions
政采云技术
政采云技术
Feb 8, 2022 · Industry Insights

Unlocking Enterprise Value with a Data Middle Platform: Architecture & Indicators

This article traces the evolution from traditional data warehouses to modern data lakes and data middle platforms, explains why siloed data development hampers efficiency, and details the architecture and indicator‑library design used by Zhengcaiyun to achieve unified, reusable data services.

Big DataData GovernanceData Lakehouse
0 likes · 14 min read
Unlocking Enterprise Value with a Data Middle Platform: Architecture & Indicators
DataFunTalk
DataFunTalk
Jan 7, 2022 · Artificial Intelligence

Building an Intelligent Risk Control Tool System: Architecture and Key Components

This article presents a comprehensive overview of constructing an intelligent risk control tool system, detailing its evolution from manual processes to automated platforms, describing the core "three‑piece" suite (model, decision, and feature platforms) along with supporting data and monitoring platforms, and explaining the functions and interactions of each module such as data ingestion, feature engineering, automated modeling, decision flow, and real‑time monitoring.

Data PlatformModelingdecision engine
0 likes · 13 min read
Building an Intelligent Risk Control Tool System: Architecture and Key Components
Volcano Engine Developer Services
Volcano Engine Developer Services
Jan 4, 2022 · Big Data

How ByteDance Scales EB-Level Data: Architecture, BP Model & Real-Time Insights

ByteDance’s data platform, built over seven years, now handles exabyte-scale data and over 100 million TPS, using a hybrid “middle‑platform + Business Partner” model, custom engines like ClickHouse/ByteHouse, agile governance, and a suite of products to support internal and external businesses, illustrating large-scale big-data engineering practices.

Big DataByteDanceClickHouse
0 likes · 22 min read
How ByteDance Scales EB-Level Data: Architecture, BP Model & Real-Time Insights
DataFunSummit
DataFunSummit
Jan 2, 2022 · Big Data

Data Governance Practices and Product Perspective at Beike Zhaofang

This article shares Beike Zhaofang’s two‑year experience building a data governance center, covering the purpose and scope of governance, how the company tailors the focus to its business and system characteristics, the middle‑platform construction approach, project goal management, product and operation rollout, and the challenges and solutions encountered.

Data PlatformData Qualitydata sharing
0 likes · 14 min read
Data Governance Practices and Product Perspective at Beike Zhaofang
DataFunTalk
DataFunTalk
Dec 3, 2021 · Fundamentals

Data Governance Practices and Lessons from Beike Zhaofang

This article outlines Beike Zhaofang's data governance framework, covering its purpose, three core dimensions—sharing, accuracy, and usability—how the scope is focused based on company characteristics, the necessity of data convergence and efficiency building, product architecture, target management, operational experiences, and challenges with corresponding measures.

Data PlatformOperational EfficiencyProduct Design
0 likes · 15 min read
Data Governance Practices and Lessons from Beike Zhaofang
iQIYI Technical Product Team
iQIYI Technical Product Team
Dec 3, 2021 · Big Data

iQIYI Basic Data Platform: Architecture, High Availability, and Service Practices

iQIYI’s Basic Data Platform unifies data exchange across dozens of business lines by providing massive storage, distribution, online query and offline analysis services, employing an access layer, unified management, fine‑grained governance, dual‑cluster ID generation, active‑standby HBase with MongoDB WAL, RocketMQ messaging with server‑side filtering, and horizontally scalable read replicas to ensure high availability and performance.

Data PlatformHBaseMessage Queue
0 likes · 13 min read
iQIYI Basic Data Platform: Architecture, High Availability, and Service Practices
Baidu Geek Talk
Baidu Geek Talk
Nov 8, 2021 · Artificial Intelligence

Application of Intelligent Grading and Risk Assessment Models in Commercial Platforms

The article describes an intelligent grading and risk‑assessment framework for commercial platforms that unifies process control, feature mining, data collection, storage, strategy management, and annotation, enabling automated testing conversion with 94% accuracy, 90% recall, 8% conversion uplift, and surfacing dozens of bugs while supporting scalable, configurable deployment.

AIAutomationData Platform
0 likes · 13 min read
Application of Intelligent Grading and Risk Assessment Models in Commercial Platforms
IT Architects Alliance
IT Architects Alliance
Oct 20, 2021 · Backend Development

Technical Middle Platform Architecture Overview: Core, Data, Retail, Real‑time, and Enterprise Perspectives

This article presents a comprehensive overview of technical middle‑platform architectures, covering core platform diagrams, banking data structures, retail industry models, backend design principles, real‑time data pipelines, enterprise evolution stages, and case studies from Alibaba and NetEase, illustrated with numerous diagrams.

BackendData PlatformEnterprise
0 likes · 8 min read
Technical Middle Platform Architecture Overview: Core, Data, Retail, Real‑time, and Enterprise Perspectives
Big Data Technology Architecture
Big Data Technology Architecture
Sep 17, 2021 · Big Data

Real‑time Computing Platform Architecture, Flink Migration, and One‑stop Platform at 58.com

This article details the design and implementation of 58.com’s real‑time computing platform, covering its architecture, data ingestion, storage, Flink‑based stream processing, SQL extensions, performance optimizations, Storm‑to‑Flink migration tools, the Wstream management console, state handling, monitoring, and future roadmap.

Data PlatformFlinkReal‑Time Computing
0 likes · 16 min read
Real‑time Computing Platform Architecture, Flink Migration, and One‑stop Platform at 58.com
Big Data Technology & Architecture
Big Data Technology & Architecture
Sep 15, 2021 · Big Data

Linkis: Open‑Source Big Data Middleware Joins the Apache Incubator

Linkis, an open‑source computing middleware from WeBank, has entered the Apache Software Foundation Incubator, offering REST/WebSocket/JDBC interfaces to a wide range of engines such as Spark, Hive, Presto and Flink, and providing powerful governance, orchestration, and resource‑management capabilities for big‑data platforms.

Apache IncubatorBig DataData Platform
0 likes · 5 min read
Linkis: Open‑Source Big Data Middleware Joins the Apache Incubator
IT Architects Alliance
IT Architects Alliance
Sep 12, 2021 · Industry Insights

Data Warehouse vs. Database: Core Differences and Building a Data Platform

This article explains what a data warehouse is, contrasts it with traditional databases, outlines how to design and build a data warehouse—including model selection, topic domain division, bus matrix, layered architecture, and data governance—then expands to the concept of a data middle platform and its distinction from data lakes and big‑data platforms.

Big DataData GovernanceData Platform
0 likes · 18 min read
Data Warehouse vs. Database: Core Differences and Building a Data Platform
IT Architects Alliance
IT Architects Alliance
Sep 5, 2021 · Big Data

Big Data Platform Architecture: Core Layers, Technologies, and Practices

This article outlines a typical big data platform architecture, detailing its core layers—data acquisition, storage and analysis, sharing, application, real‑time computation, and task scheduling—while introducing key technologies such as Flume, HDFS, Hive, Spark, DataX, and monitoring considerations.

Big DataData PlatformHadoop
0 likes · 9 min read
Big Data Platform Architecture: Core Layers, Technologies, and Practices
DataFunSummit
DataFunSummit
Jul 30, 2021 · Big Data

NetEase Big Data Ecosystem and User Profiling Practices

This article presents an in‑depth overview of NetEase's massive big‑data ecosystem, its diverse product lines, the full‑link data platform matrix, user‑profile taxonomy, ID‑mapping techniques, regional domain insights, tag management, quality assurance mechanisms, and real‑world case studies demonstrating applications in marketing, recommendation, growth, and anti‑fraud scenarios.

Data PlatformID-MappingNetEase
0 likes · 13 min read
NetEase Big Data Ecosystem and User Profiling Practices
IT Architects Alliance
IT Architects Alliance
Jul 20, 2021 · Big Data

Understanding Data Middle Platform: Layers, Architecture, and Implementation Methodology

The article explains the concept of a data middle platform, detailing its three-layer structure—data model, data service, and data development—illustrates how data modeling enables cross-domain integration, how services encapsulate data for flexible consumption, and how development tools support customized data applications, using a telecom operator example.

Big DataData ArchitectureData Platform
0 likes · 2 min read
Understanding Data Middle Platform: Layers, Architecture, and Implementation Methodology
ITPUB
ITPUB
Jul 7, 2021 · Big Data

How NetEase Cloud Music Scaled Its Data Warehouse for Billion‑User Traffic

This article details NetEase Cloud Music's journey of redesigning its data warehouse and governance processes to support over a billion monthly active users, covering pain points, standardization, shared services, self‑service tools, and the resulting improvements in data quality, latency, and operational efficiency.

AnalyticsData GovernanceData Platform
0 likes · 19 min read
How NetEase Cloud Music Scaled Its Data Warehouse for Billion‑User Traffic
DataFunTalk
DataFunTalk
Jun 30, 2021 · Big Data

Kuaishou Havok Data Service Platform and Its High‑Availability Assurance System

The article introduces Kuaishou's Havok data‑service platform—a one‑stop, configuration‑driven solution that lowers development barriers—and details the comprehensive high‑availability architecture, including hierarchical isolation, elastic scaling, link grading, disaster recovery, and rate‑limiting mechanisms that enable zero‑failure support for large‑scale events.

Data PlatformHavokKuaishou
0 likes · 11 min read
Kuaishou Havok Data Service Platform and Its High‑Availability Assurance System
Architecture Digest
Architecture Digest
Jun 24, 2021 · Big Data

Kuaishou's Big Data Service Platform: Architecture, Key Technologies, and Future Outlook

This article introduces Kuaishou's data platform serviceification, outlining the background challenges for data engineers, the platform's architecture and key technologies such as configuration‑driven development, multi‑mode APIs, data acceleration, and high‑availability mechanisms, and concludes with a summary of achievements and future directions.

Big DataData AccelerationData Platform
0 likes · 12 min read
Kuaishou's Big Data Service Platform: Architecture, Key Technologies, and Future Outlook
Xianyu Technology
Xianyu Technology
Jun 8, 2021 · Big Data

Longgong Data Analysis Platform: Architecture and Solutions for Large‑Scale Structured Data

The Longgong Data Analysis Platform enables Idle Fish to capture, store, and analyze billions of structured product attributes in real time across more than 8,000 categories, using TableStore, MySQL, ODPS, and a distributed scheduler to achieve over 50% query speedup, 80% category coverage, and rapid support for search and recommendation teams.

AlibabaBig DataData Platform
0 likes · 9 min read
Longgong Data Analysis Platform: Architecture and Solutions for Large‑Scale Structured Data
IT Architects Alliance
IT Architects Alliance
May 25, 2021 · Big Data

How Modern Data Middle Platforms Power Real‑Time and Offline Analytics

This article provides a comprehensive technical overview of data middle platforms, covering data aggregation, offline and real‑time development, smart operations, data asset management, governance, service layers, platform implementations, warehouse layering, and key differences between offline and real‑time data warehouses.

Big DataData GovernanceData Platform
0 likes · 26 min read
How Modern Data Middle Platforms Power Real‑Time and Offline Analytics
Big Data Technology & Architecture
Big Data Technology & Architecture
May 15, 2021 · Big Data

One‑Stop Big Data Platform Construction: Practices from WeBank, Beike, and iQIYI

This article shares practical notes on building a one‑stop big data platform, outlining essential functions such as data extraction, cleaning, storage, analysis, governance, and security, and presents implementation case studies from WeBank, Beike, and iQIYI to illustrate real‑world architectures and solutions.

Big DataCase StudyData Governance
0 likes · 8 min read
One‑Stop Big Data Platform Construction: Practices from WeBank, Beike, and iQIYI
Architecture Digest
Architecture Digest
May 7, 2021 · Big Data

Comprehensive Overview of Data Middle Platform Architecture and Practices

This article provides a detailed introduction to data middle platform concepts, covering data aggregation, ingestion tools, offline and real‑time development, data governance, service layers, monitoring, and deployment patterns, illustrating how enterprises build unified data ecosystems across various industries.

Big DataData GovernanceData Platform
0 likes · 25 min read
Comprehensive Overview of Data Middle Platform Architecture and Practices
TAL Education Technology
TAL Education Technology
Apr 15, 2021 · Big Data

Global Feature Pool Architecture and Workflow for Data‑Driven Growth

The article describes a unified global feature pool architecture that standardizes offline and real‑time feature production, management, and service layers using Hive, Spark, Flink, Kafka, MySQL, and Hologres to break data silos, improve algorithm development efficiency, and boost growth business performance.

Data Platformdata pipelinefeature engineering
0 likes · 7 min read
Global Feature Pool Architecture and Workflow for Data‑Driven Growth
Baidu Intelligent Testing
Baidu Intelligent Testing
Apr 14, 2021 · Artificial Intelligence

Quality Metric Model for Automated Testing and Risk Assessment in Commercial Platforms

This article describes Baidu's quality metric model that integrates development process data, self‑testing and automation data to automate test prioritization, estimate project risk, and improve testing efficiency through a six‑component platform covering process control, feature mining, data collection, storage, strategy management, and annotation.

AIAutomated TestingData Platform
0 likes · 15 min read
Quality Metric Model for Automated Testing and Risk Assessment in Commercial Platforms
DataFunTalk
DataFunTalk
Apr 14, 2021 · Big Data

Beike's Data Development Platform: Evolution, Architecture, and Future Outlook

The talk by Beike senior engineer Yang Zongqiang details the evolution of the company's data development platform, covering background, three architecture upgrades, platform features such as metadata management, data integration, scheduling, quality assurance, and future directions for building an enterprise‑grade big‑data system.

Data PlatformData Qualitymetadata
0 likes · 21 min read
Beike's Data Development Platform: Evolution, Architecture, and Future Outlook
Big Data Technology Architecture
Big Data Technology Architecture
Mar 30, 2021 · Big Data

Beike OLAP Platform: Druid Adoption, Architecture, Performance Comparison, and Operational Optimizations

The article details Beike's OLAP platform built on Druid, covering its four‑layer architecture, selection criteria, performance comparisons with Kylin, data ingestion workflows, custom improvements for data import and real‑time distinct counting, and operational measures such as caching, dynamic throttling, and HDFS storage optimization.

BeikeData PlatformDruid
0 likes · 18 min read
Beike OLAP Platform: Druid Adoption, Architecture, Performance Comparison, and Operational Optimizations
DataFunTalk
DataFunTalk
Mar 12, 2021 · Big Data

Evolution of the Beike Data Platform: From Traditional Real‑Estate Business to Integrated Big Data Solutions

This article shares how Beike, a 20‑year‑old traditional real‑estate company, built and evolved its data platform to support digital transformation, describing the business background, data characteristics, user groups, application scenarios, platform challenges, the Odin analysis platform, data‑as‑asset management, and future directions.

Data AnalyticsData PlatformDigital Transformation
0 likes · 20 min read
Evolution of the Beike Data Platform: From Traditional Real‑Estate Business to Integrated Big Data Solutions
DataFunTalk
DataFunTalk
Mar 6, 2021 · Big Data

Youzan Data Governance: Quality Assurance, Cost Management, and Operational Practices

This article explains Youzan's data governance framework, covering the definition of data governance, the company's asset‑centric approach, quantitative quality scoring, cost‑based pricing formulas, billing and allocation mechanisms, continuous operational improvements, and the measurable outcomes achieved.

Cost OptimizationData PlatformData Quality
0 likes · 17 min read
Youzan Data Governance: Quality Assurance, Cost Management, and Operational Practices
21CTO
21CTO
Mar 2, 2021 · Big Data

How Suning’s Data Platform Unifies OLAP, Metrics, Visualization & Reporting

Suning’s Data Middle Platform integrates an accelerated OLAP engine, a star‑schema metric system, a visualization tool built on standardized dimensions, and a unified report portal to solve data silos, improve security, and enable enterprises to evolve into technology‑driven organizations.

AnalyticsBig DataData Platform
0 likes · 3 min read
How Suning’s Data Platform Unifies OLAP, Metrics, Visualization & Reporting
DevOps
DevOps
Feb 23, 2021 · Cloud Native

Minsheng Bank Data Middle Platform: Cloud‑Native Architecture and Tooling Practices

This article details Minsheng Bank’s data middle‑platform construction, its alignment with cloud‑native principles, the challenges it addresses, and the suite of micro‑service, DevOps and tooling innovations—including a one‑stop DevOps workbench, code generators, automated validation, and full‑link tracing—implemented to support diverse financial data services.

BankingData PlatformMicroservices
0 likes · 14 min read
Minsheng Bank Data Middle Platform: Cloud‑Native Architecture and Tooling Practices
ITFLY8 Architecture Home
ITFLY8 Architecture Home
Feb 2, 2021 · Big Data

How Kuaishou Scaled Data Services with a Config‑Driven Big Data Platform

This article explains how Kuaishou’s data‑service platform tackles high development barriers and repetitive work by introducing a self‑service, configuration‑driven architecture, multi‑mode APIs, efficient data acceleration, and robust high‑availability mechanisms, while outlining its evolution and future roadmap.

Data AccelerationData PlatformService Architecture
0 likes · 14 min read
How Kuaishou Scaled Data Services with a Config‑Driven Big Data Platform
360 Smart Cloud
360 Smart Cloud
Jan 28, 2021 · Big Data

Overview of the Qirin Big Data Platform: Architecture, Modules, and Capabilities

The article provides a comprehensive overview of the Qirin big‑data platform, detailing its architecture, core modules such as resource management, metadata, data ingestion, task development, interactive query, and self‑service analysis, and outlines future development plans for the system.

Data PlatformResource Managementdata ingestion
0 likes · 12 min read
Overview of the Qirin Big Data Platform: Architecture, Modules, and Capabilities
Youzan Coder
Youzan Coder
Jan 25, 2021 · Big Data

ClickHouse: Principles, Architecture, and Deployment at Youzan

The article explains ClickHouse’s high‑performance columnar OLAP design, its vectorized execution, sparse primary‑key indexes and MergeTree engines, contrasts it with ROLAP/MOLAP approaches, and details Youzan’s large‑scale deployment—including dual‑replica clusters, ingestion pipelines, routing architecture, current challenges, and future container‑based expansion plans.

ClickHouseData PlatformMergeTree
0 likes · 22 min read
ClickHouse: Principles, Architecture, and Deployment at Youzan
Big Data Technology & Architecture
Big Data Technology & Architecture
Jan 15, 2021 · Big Data

Evolution and Architecture of Major Chinese Big Data Platforms: Taobao, Didi, Meituan, 360, Kuaishou, and JD

This article reviews the evolution, architecture, and key components of major Chinese big‑data platforms—including those of Taobao, Didi, Meituan, 360, Kuaishou, and JD—highlighting data ingestion, storage, processing engines, scheduling systems, and service‑oriented designs that underpin their large‑scale data operations.

Big DataData PlatformHadoop
0 likes · 14 min read
Evolution and Architecture of Major Chinese Big Data Platforms: Taobao, Didi, Meituan, 360, Kuaishou, and JD
21CTO
21CTO
Jan 7, 2021 · Big Data

How Kuaishou Built a Scalable Big Data Service Platform to Eliminate Redundant Development

This article explains Kuaishou's data service platform, detailing the background challenges of high development barriers and duplicated work, the platform's architecture and key technologies such as configuration‑driven development, multi‑mode APIs, data acceleration, and high‑availability mechanisms, and concludes with future directions.

Big DataData AccelerationData Platform
0 likes · 12 min read
How Kuaishou Built a Scalable Big Data Service Platform to Eliminate Redundant Development
360 Tech Engineering
360 Tech Engineering
Jan 7, 2021 · Big Data

Overview of the Qirin Big Data Platform Architecture and Core Modules

The article introduces the Qirin big data platform—a one‑stop solution covering resource management, metadata, data ingestion, task development, interactive querying, and self‑service analysis—detailing its modular architecture, typical processing workflow, and future development plans for enterprise‑wide data services.

Big DataData PlatformResource Management
0 likes · 11 min read
Overview of the Qirin Big Data Platform Architecture and Core Modules
ITFLY8 Architecture Home
ITFLY8 Architecture Home
Dec 18, 2020 · Big Data

Unlocking the Data Middle Platform: From Ingestion to Real‑Time Analytics

This article provides a comprehensive overview of data middle platform concepts, covering data aggregation, collection tools, development modules, job scheduling, baseline control, heterogeneous storage, permission management, real‑time and offline processing, governance, services, and implementation details for building robust big‑data solutions.

Data GovernanceData PlatformETL
0 likes · 25 min read
Unlocking the Data Middle Platform: From Ingestion to Real‑Time Analytics
Youzan Coder
Youzan Coder
Dec 15, 2020 · Industry Insights

How Youzan Built a Full‑Scale Data Cost Billing System: From SDK to Multi‑Dimensional Analysis

This article details Youzan's end‑to‑end construction of a unified data‑center cost billing system, covering background goals, multi‑type cost support, SDK‑based information collection, cost quantification for offline, real‑time and platform tools, full‑business coverage, multi‑dimensional analysis models, operational rollout, and future plans.

Big DataData PlatformOperations
0 likes · 19 min read
How Youzan Built a Full‑Scale Data Cost Billing System: From SDK to Multi‑Dimensional Analysis
DataFunTalk
DataFunTalk
Dec 12, 2020 · Big Data

NetEase Yanxuan Tag and Profile Platform Construction Practice

This article presents NetEase Yanxuan's comprehensive approach to building a tag and profile middle‑platform, detailing the concepts of tags and profiles, their business value, the platform's architecture and functional modules, and the methodologies for constructing tag systems and applying profiles to drive data‑driven operations.

Business IntelligenceData AssetData Platform
0 likes · 16 min read
NetEase Yanxuan Tag and Profile Platform Construction Practice
DataFunSummit
DataFunSummit
Dec 11, 2020 · Big Data

58.com Big Data Application Practice: Architecture, Challenges, and Solutions

This article presents 58.com’s large‑scale big data platform, detailing its business scope, the WMDA one‑stop analytics system, the Wanxiang user‑portrait service, the technical challenges of massive daily data ingestion, multi‑dimensional analysis, OLAP engine selection (Kylin, Druid), bitmap‑based user‑group processing, scheduling, and overall data service architecture.

Data PlatformDruidKylin
0 likes · 13 min read
58.com Big Data Application Practice: Architecture, Challenges, and Solutions
High Availability Architecture
High Availability Architecture
Dec 4, 2020 · Big Data

Building and Implementing a Big Data Platform: From Scripts to Services and Lambda Architecture

This article outlines the step‑by‑step approach to constructing a big data platform—starting with script toolization, evolving through tool services, platformization, and productization, comparing business‑scenario and generic‑component construction methods, and detailing the Lambda architecture for data collection, processing, and visualization to drive business operations.

Data PlatformData visualizationLambda architecture
0 likes · 16 min read
Building and Implementing a Big Data Platform: From Scripts to Services and Lambda Architecture
Selected Java Interview Questions
Selected Java Interview Questions
Dec 4, 2020 · Product Management

What Is a Middle Platform? Understanding Platformization and Its Role in Enterprise Architecture

This article explains the concept of a middle platform, its purpose in improving system reuse and user responsiveness, the reasons for platformization, the distinction between front‑end, back‑end and middle platforms, and how business and data middle platforms can be evaluated and operated within modern enterprises.

Business ReuseData PlatformPlatformization
0 likes · 14 min read
What Is a Middle Platform? Understanding Platformization and Its Role in Enterprise Architecture
dbaplus Community
dbaplus Community
Nov 26, 2020 · Big Data

Silicon Valley's Data Middle Platform Secrets: EA, Twitter, Airbnb, Uber

This article examines how leading Silicon Valley companies such as EA, Twitter, Airbnb, and Uber design and operate data middle platforms—detailing their architectures, data collection pipelines, standardization efforts, real‑time and batch processing, and the business impact of shared data capabilities.

Big DataData ArchitectureData Platform
0 likes · 25 min read
Silicon Valley's Data Middle Platform Secrets: EA, Twitter, Airbnb, Uber
Beike Product & Technology
Beike Product & Technology
Nov 13, 2020 · Big Data

Beike One‑Stop Big Data Development Platform: Architecture, Evolution, and Future Outlook

The article summarizes Beike's one‑stop big data development platform, describing its data business background, the evolution from a simple Hadoop‑Kafka‑Hive stack to a metadata‑driven, asset‑oriented platform, and outlines current capabilities in data management, integration, scheduling, quality, openness, and future plans.

Big DataData GovernanceData Platform
0 likes · 11 min read
Beike One‑Stop Big Data Development Platform: Architecture, Evolution, and Future Outlook
Yanxuan Tech Team
Yanxuan Tech Team
Nov 5, 2020 · Product Management

How NetEase Yanxuan Built an AI‑Powered Omnichannel Reach System

This article explains why Yanxuan, a brand e‑commerce platform, created its own omnichannel user‑reach system, outlines the business problems it solves, describes the four‑layer architecture—including data, AI, application, and business layers—and shares early results and future work.

AI schedulingData PlatformE‑commerce
0 likes · 12 min read
How NetEase Yanxuan Built an AI‑Powered Omnichannel Reach System
NetEase Yanxuan Technology Product Team
NetEase Yanxuan Technology Product Team
Nov 5, 2020 · Industry Insights

How Yanxuan Built an AI‑Powered Omnichannel Reach System to Maximize ROI

This article examines Yanxuan’s transition to an AI‑driven omnichannel user‑reach system, detailing the business challenges of fragmented channels, the four‑step intelligent workflow, and a four‑layer architecture that integrates data platforms, algorithm services, applications, and business operations to maximize ROI.

AI schedulingData PlatformMarketing Optimization
0 likes · 12 min read
How Yanxuan Built an AI‑Powered Omnichannel Reach System to Maximize ROI
Sohu Tech Products
Sohu Tech Products
Oct 14, 2020 · R&D Management

Understanding Mid‑Platform (Zhongtai) Architecture: Concepts, Types, and Industry Practices

This comprehensive article explains the concept of the mid‑platform (Zhongtai), its origins, classification into business, data, algorithm, technical, R&D, and organizational platforms, examines the challenges it solves, and reviews real‑world implementations by Alibaba, Huawei, NetEase, Baidu, and Tencent, concluding with practical guidance for adopting a suitable platform strategy.

Business strategyData PlatformR&D management
0 likes · 30 min read
Understanding Mid‑Platform (Zhongtai) Architecture: Concepts, Types, and Industry Practices
Programmer DD
Programmer DD
Sep 29, 2020 · Artificial Intelligence

How Ride‑Hailing Giants Use AI‑Powered Data Platforms to Optimize Pricing and Safety

This article examines how O2O ride‑hailing platforms such as Uber and Didi rely on layered system architectures and AI‑driven data middle platforms to enable intelligent dispatch, dynamic pricing, and safety mechanisms, detailing the core components, matching algorithms, and machine‑learning models that power these services.

AIData PlatformRide Hailing
0 likes · 20 min read
How Ride‑Hailing Giants Use AI‑Powered Data Platforms to Optimize Pricing and Safety
Programmer DD
Programmer DD
Sep 28, 2020 · Artificial Intelligence

How Ride‑Hailing Platforms Use AI for Smart Matching and Pricing

This article examines how O2O ride‑hailing services like Uber and Didi rely on layered system architecture and algorithmic data platforms to enable intelligent matching, dynamic pricing, and safety mechanisms through machine‑learning models and real‑time data integration.

AIData PlatformRide Hailing
0 likes · 20 min read
How Ride‑Hailing Platforms Use AI for Smart Matching and Pricing
DataFunTalk
DataFunTalk
Sep 6, 2020 · Big Data

OPPO's Real-Time Data Warehouse Architecture and Practices Based on Apache Flink

OPPO's data platform engineer Zhang Jun shares the design and implementation of OPPO's real‑time data warehouse built on Apache Flink, covering background, top‑level architecture, practical deployment, and future directions such as enhanced SQL development, resource scheduling, and automated configuration.

Data PlatformFlinkSQL
0 likes · 15 min read
OPPO's Real-Time Data Warehouse Architecture and Practices Based on Apache Flink
Full-Stack Internet Architecture
Full-Stack Internet Architecture
Aug 27, 2020 · Product Management

Understanding the Benefits of Business and Data Middle Platforms for Enterprises

The article explains how implementing business and data middle platforms can enhance enterprise capabilities, streamline processes, foster innovation, and provide strategic advantages for leaders, managers, IT teams, and developers by centralizing standards, enabling data-driven decision‑making, and reducing operational costs.

Data PlatformDigital Transformationbusiness architecture
0 likes · 4 min read
Understanding the Benefits of Business and Data Middle Platforms for Enterprises
Didi Tech
Didi Tech
Aug 26, 2020 · Big Data

Real-time Data Warehouse Construction at Didi: Architecture, Practices, and Lessons

To support Didi’s fast‑growing car‑pool service, a real‑time data warehouse was built using a streamlined layered architecture—ODS, DWD, DIM, DWM, and APP—leveraging Flink‑based StreamSQL, Kafka, Druid and ClickHouse to deliver minute‑level analytics, dashboards, monitoring, and cross‑business interfaces while planning unified meta‑store integration.

Big Data ArchitectureData PlatformFlink
0 likes · 20 min read
Real-time Data Warehouse Construction at Didi: Architecture, Practices, and Lessons
DataFunTalk
DataFunTalk
Aug 21, 2020 · Big Data

Design and Implementation of 58.com Commercial DMP Platform

This talk presents the architecture, feature extraction, storage, real-time computation, monitoring, and optimization strategies of 58.com’s commercial DMP platform, detailing business requirements, system design across data, storage, compute, and service layers, and future plans for unified services and advanced analytics.

DMPData PlatformReal-time Processing
0 likes · 13 min read
Design and Implementation of 58.com Commercial DMP Platform
Big Data Technology & Architecture
Big Data Technology & Architecture
Aug 16, 2020 · Big Data

Designing a Reusable and Standardized Data Warehouse Model for a Data Middle Platform

The article explains how to evaluate and improve data warehouse design by measuring completeness, reusability and standardization, proposes concrete metrics such as cross‑layer reference rate and model reuse coefficient, and outlines a step‑by‑step process—from ODS control to domain division, dimension unification, fact‑table integration, model development and migration—while introducing the EasyDesign tool for systematic management.

Data PlatformMetricsReusability
0 likes · 14 min read
Designing a Reusable and Standardized Data Warehouse Model for a Data Middle Platform
Suning Technology
Suning Technology
Aug 14, 2020 · Big Data

Building SuNing’s Supply‑Chain Data Platform with DDD and Big‑Data Design

This article recounts SuNing’s step‑by‑step journey of designing and implementing a supply‑chain data middle platform, outlining its business rationale, DDD‑based domain modeling, layered system architecture, and practical deployment insights that illustrate how a tailored big‑data solution can enhance data services and governance.

Big DataDDDData Governance
0 likes · 11 min read
Building SuNing’s Supply‑Chain Data Platform with DDD and Big‑Data Design
Architects' Tech Alliance
Architects' Tech Alliance
Aug 5, 2020 · Big Data

Data Middle Platform: Concepts, Architecture, and Implementation

This article provides a comprehensive overview of data middle platforms, covering data aggregation, collection tools, offline and real‑time development, job scheduling, data governance, multi‑layer architecture, ETL processes, and various industry use cases, illustrating how enterprises build and manage unified data assets.

Data PlatformETL
0 likes · 23 min read
Data Middle Platform: Concepts, Architecture, and Implementation
DataFunTalk
DataFunTalk
Aug 4, 2020 · Artificial Intelligence

Weibo Machine Learning Platform (WML) Overview and Flink Applications

This article presents an in‑depth overview of Weibo's large‑scale machine learning platform, detailing its multi‑layer architecture, development workflow, CTR model evolution, and how Apache Flink is employed for real‑time data processing, sample services, multi‑stream joins, multimedia feature generation, and future roadmap plans.

CTRData PlatformFlink
0 likes · 12 min read
Weibo Machine Learning Platform (WML) Overview and Flink Applications
Tencent Cloud Developer
Tencent Cloud Developer
Jul 30, 2020 · Big Data

Cost Governance Practices in Youzan's Data Middle Platform

Youzan's data middle platform faced cost growth outpacing business due to low utilization and storage inefficiencies; they applied utilization standards, containerization, COS storage migration, offline task optimization, and fine-grained cost-billing, achieving a 12% compute boost, 17% batch savings, 80% storage cost cut, and over 25% overall cost reduction.

Big DataData Cost ManagementData Platform
0 likes · 24 min read
Cost Governance Practices in Youzan's Data Middle Platform
DataFunTalk
DataFunTalk
Jul 22, 2020 · Big Data

Building a Real-Time Computing Platform with Apache Flink at iQIYI: Architecture, Improvements, and Business Cases

iQIYI’s senior data engineer shares the evolution of its big‑data services from Hadoop to a Flink‑based real‑time computing platform, detailing architecture, monitoring improvements, StreamingSQL capabilities, business use cases like recommendation and deep‑learning data generation, and future plans for unified stream‑batch processing.

Apache FlinkData PlatformFlink
0 likes · 11 min read
Building a Real-Time Computing Platform with Apache Flink at iQIYI: Architecture, Improvements, and Business Cases
Big Data Technology Architecture
Big Data Technology Architecture
Jul 8, 2020 · Big Data

Key Interview Questions on Data Warehousing, Data Platforms, and Related Technologies

This article compiles a comprehensive set of 32 interview questions covering data warehouse fundamentals, data platform construction, modeling approaches, real‑time architectures, data quality, governance, Hive optimization, and related analytical techniques to help candidates prepare for data engineering roles.

Data PlatformData WarehouseETL
0 likes · 4 min read
Key Interview Questions on Data Warehousing, Data Platforms, and Related Technologies
Architects' Tech Alliance
Architects' Tech Alliance
Jul 1, 2020 · Big Data

Gartner’s Perspective on Building a Data Middle Platform: Strategies and Recommendations

According to Gartner, enterprises should view data middle platforms as strategic, collaborative hubs that balance data collection and connection, promote reusable analytics, integrate with digital platforms, and leverage data fabric, AI-driven tools, and graph analysis to become truly data‑driven while maintaining trust and privacy.

AnalyticsData FabricData Platform
0 likes · 12 min read
Gartner’s Perspective on Building a Data Middle Platform: Strategies and Recommendations
Big Data and Microservices
Big Data and Microservices
Jun 28, 2020 · Big Data

Data Warehouse vs Data Lake vs Data Platform vs Data Middle Platform: Which Fits Your Business?

This article compares data warehouse, data lake, data platform, and data middle platform, explaining their definitions, architectures, strengths, limitations, and use‑case differences, and provides tables that highlight how each solution handles structured and unstructured data, governance, flexibility, and business value.

Big DataData ArchitectureData Lake
0 likes · 12 min read
Data Warehouse vs Data Lake vs Data Platform vs Data Middle Platform: Which Fits Your Business?
JD Retail Technology
JD Retail Technology
Jun 17, 2020 · Operations

How JD’s Data Platforms Scaled for the 618 Mega‑Sale: Operations, Stress‑Testing, and Dual‑Stream Architecture

The article details JD’s data product teams’ systematic preparation for the 618 shopping festival, covering pressure estimation, capacity expansion, stress testing, emergency downgrade strategies, dual‑data‑center isolation, high‑fidelity end‑to‑end testing, and continuous monitoring to ensure stable, real‑time data services during massive traffic spikes.

Big DataData PlatformJD.com
0 likes · 10 min read
How JD’s Data Platforms Scaled for the 618 Mega‑Sale: Operations, Stress‑Testing, and Dual‑Stream Architecture
DataFunTalk
DataFunTalk
Jun 14, 2020 · Big Data

Practical Experience and Optimization of Apache Druid for Real‑Time OLAP at iQIYI

This article describes how iQIYI evaluated various OLAP engines, selected Apache Druid for real‑time analytics, detailed its architecture, identified performance bottlene‑cks in Coordinator, Overlord and indexing, applied configuration and resource‑allocation optimizations, and built a user‑friendly RAP platform to democratize real‑time data analysis.

Apache DruidBig DataData Platform
0 likes · 15 min read
Practical Experience and Optimization of Apache Druid for Real‑Time OLAP at iQIYI
Cloud Native Technology Community
Cloud Native Technology Community
Jun 2, 2020 · Cloud Native

Building an Enterprise Cloud‑Native Architecture: A Comprehensive Guide

This article presents a step‑by‑step, enterprise‑wide roadmap for constructing a cloud‑native system, covering the five dimensions of architecture, a detailed evolution diagram, three maturity stages, common pitfalls, and practical solutions ranging from service‑oriented redesign to micro‑service governance and data‑driven personalization.

Data PlatformMicroservicesenterprise architecture
0 likes · 57 min read
Building an Enterprise Cloud‑Native Architecture: A Comprehensive Guide
Big Data Technology Architecture
Big Data Technology Architecture
May 19, 2020 · Big Data

Design and Implementation of a Unified Data Lake Platform Using HBase, Kafka, and Elasticsearch

This article summarizes the design, architecture, and key modules of a company-wide data lake platform—named “Tianchi”—built on HBase, Kafka, and Elasticsearch, detailing data ingestion, strategy output, metadata management, indexing, monitoring, and offline analysis, and shares lessons learned and future plans.

Data PlatformElasticsearchHBase
0 likes · 11 min read
Design and Implementation of a Unified Data Lake Platform Using HBase, Kafka, and Elasticsearch
Big Data Technology & Architecture
Big Data Technology & Architecture
May 18, 2020 · Big Data

Real‑time Data Platform (RTDP): Concepts, Architecture and Design Considerations

This article examines the design of a real‑time data platform, discussing its background concepts, modern data‑warehouse perspective, architectural layers, unified data‑collection, streaming, compute and visualization platforms, and the functional, quality, stability, cost and agility considerations required for building an end‑to‑end real‑time pipeline.

Data DemocratizationData Platformarchitecture
0 likes · 17 min read
Real‑time Data Platform (RTDP): Concepts, Architecture and Design Considerations
Big Data Technology & Architecture
Big Data Technology & Architecture
May 14, 2020 · Big Data

Five-Step Methodology for Building a Data Middle Platform

The article outlines a practical five-step methodology for constructing a data middle platform, covering data resource inventory, application planning, asset construction, detailed design and implementation, and organizational planning to guide enterprises toward effective data-driven transformation.

Data AssetsData Middle PlatformData Platform
0 likes · 8 min read
Five-Step Methodology for Building a Data Middle Platform
DevOps
DevOps
Apr 8, 2020 · Operations

Bilibili DevOps Case Study: Culture, Community, User‑Driven Demand Management, High‑Performance Microservices, and Data Operations

This article presents a comprehensive DevOps case study of Bilibili, covering its cultural background, community ecosystem, user‑centric demand management, migration to high‑performance microservices, and the implementation of logging, monitoring, and real‑time data platforms to support rapid, reliable delivery.

BilibiliData PlatformDevOps
0 likes · 17 min read
Bilibili DevOps Case Study: Culture, Community, User‑Driven Demand Management, High‑Performance Microservices, and Data Operations
Cloud Native Technology Community
Cloud Native Technology Community
Mar 25, 2020 · Industry Insights

How a Top Real Estate Firm Used Cloud‑Native Middle Platforms to Accelerate Digital Transformation

The case study details how a major state‑owned real estate company, with nearly 40 years of experience, built a three‑stage cloud‑native middle‑platform strategy—business, data, and technology platforms—using microservices, containers, and Tencent Cloud TSF to achieve integrated operations, data‑driven decision making, and agile infrastructure across its nationwide projects.

Cloud NativeData PlatformDevOps
0 likes · 9 min read
How a Top Real Estate Firm Used Cloud‑Native Middle Platforms to Accelerate Digital Transformation
Tencent Cloud Developer
Tencent Cloud Developer
Feb 13, 2020 · Big Data

Data Middle Platform: Vision, Architecture, and Business Value

The Data Middle Platform, described by Shi Kai, is a service‑oriented architecture that transforms raw enterprise data into reusable, real‑time APIs for business applications, bridging the gap between traditional warehouses and front‑end systems, accelerating digital transformation through unified governance, rapid development, and direct business value.

Big DataData ArchitectureData Middle Platform
0 likes · 26 min read
Data Middle Platform: Vision, Architecture, and Business Value
Big Data Technology Architecture
Big Data Technology Architecture
Feb 3, 2020 · Big Data

NetEase Data Foundation Platform Construction – Technical Sharing

This article, originally shared by NetEase’s data expert Jiang Hongxiang on DataFun, outlines the construction of NetEase’s data foundation platform, covering database kernel insights and the implementation of the ad‑hoc query engine Impala with the distributed storage system Kudu, offering valuable big‑data engineering practices.

Data PlatformImpalaKudu
0 likes · 4 min read
NetEase Data Foundation Platform Construction – Technical Sharing