Insights from Data Platform Experts: Distributed Transactions, Aurora, and HBase
A recent data platform salon in Beijing gathered five leading experts who shared practical knowledge on data middle platforms, distributed transaction patterns, SQL audit design, Amazon Aurora's architecture, and JD's large‑scale HBase deployment, offering actionable guidance for modern enterprise data engineering.
Data Platform & Data Middle Platform Overview
Speaker Zhang Maosen, chief engineer at Didi, distinguished the concepts of a data platform versus a data middle platform, emphasizing that a data middle platform should be "thousand bodies, thousand faces"—a fully digitalized layer that extracts value from data and adapts to organizational change. He highlighted that the decision to build a data middle platform or a business middle platform depends on a company's development stage, citing Alibaba's early focus on a business middle platform.
Distributed Transaction Solutions for Finance
Yan Along, senior R&D engineer at Aikesheng, reviewed common distributed transaction models such as XA, TCC, and Sagas, providing criteria for selecting the appropriate pattern. He introduced the open‑source financial‑grade transaction framework txle, built on ServiceComb Pack, which ensures eventual consistency. Yan compared workflow, exception handling, global transaction error processing, and service degradation scenarios, noting that txle was open‑sourced on October 24.
Deep Dive into Amazon Aurora (MySQL‑compatible)
AWS architect Lv Lin explained Aurora’s design from three angles: performance, availability & durability, and manageability. Aurora follows the philosophy "log is database" and separates storage from compute, a key differentiator in public cloud. The system maintains six replicas, requiring only four successful writes to consider a transaction committed, enabling flexible scaling for both read and write workloads while remaining MySQL‑compatible.
SQL Audit Rules Design and Implementation
Fu Yi, senior database expert at Xinju Network, discussed the challenges of modern database management and the need for automated, intelligent SQL audit. He described the principles behind audit rule design, integration into the work‑order process, and continuous monitoring that enables self‑discovery, self‑diagnosis, and self‑optimization, thereby enforcing SQL development standards before and after deployment.
JD’s HBase‑Based NoSQL Platform
Wu Yiran, head of JD’s HBase platform, shared three main topics: trends in NoSQL, JD’s evolution and use cases of HBase, and practical experiences. He highlighted the massive data volume and high‑concurrency requirements that demand millisecond‑level response times. The platform’s construction addressed multi‑tenant isolation, permission management, active‑active (dual‑data‑center) design, and comprehensive monitoring and alerting.
Event Recap
The salon attracted a full house, with attendees crowding even the seats beyond the main hall. Participants engaged actively during breaks, surrounding the speakers to ask detailed technical questions. The organizers thanked the speakers and participants, and announced future events for continued knowledge sharing.
Signed-in readers can open the original source through BestHub's protected redirect.
This article has been distilled and summarized from source material, then republished for learning and reference. If you believe it infringes your rights, please contactand we will review it promptly.
dbaplus Community
Enterprise-level professional community for Database, BigData, and AIOps. Daily original articles, weekly online tech talks, monthly offline salons, and quarterly XCOPS&DAMS conferences—delivered by industry experts.
How this landed with the community
Was this worth your time?
0 Comments
Thoughtful readers leave field notes, pushback, and hard-won operational detail here.
