Design Insights of Bilibili's Big Data Development Governance Platform
This article outlines Bilibili's data‑driven approach, describing the five‑year development of its big‑data development governance platform, its user segmentation, product positioning, data‑map and governance product designs, operational methods, value evaluation, and future roadmap, highlighting significant efficiency gains and user impact.
Bilibili, a data‑driven company, has built a comprehensive big‑data development governance platform over five years, encompassing data integration, development, governance, security, and analysis, serving all business units.
The platform serves 60% of employees, primarily technical developers, product managers, operations, algorithm engineers, analysts, and data developers, categorized into high‑level developers, mid‑level users, and data beginners.
Product positioning focuses on professionalism, low entry barriers, standardization, and closed‑loop operations, aiming to meet professional data development needs while allowing easy data creation, retrieval, and usage.
Key product components include a data map (metadata portal) offering search, metadata details, preview, lineage, and management, and a data governance suite built on abstract configurations, enabling flexible, reusable governance actions.
Operational methods combine point (user) 1‑v‑1 standardization, line (business) periodic nodes, and surface (platform) systematic feedback, forming a comprehensive data operation framework.
Data value is evaluated through ROI metrics covering query heat, ETL/API usage, BI report popularity, and other factors, with a weighted scoring system to support custom data value assessments.
Product impact includes increasing data‑map penetration from 30% to 60%, boosting table recommendation heat by 40% and user satisfaction by 33%, and improving top‑value data heat by 20%.
Future plans involve abstract governance objects, configurable operations, automated issue generation, and streamlined workflows, aiming to reduce governance latency, improve visibility, and enhance efficiency.
Overall, the platform’s product features, operational system, and value evaluation have significantly improved data operations, cutting development time, handling over 80,000 governance tasks, saving more than 500 wan RMB, and reducing over 100 person‑days of effort.
DataFunSummit
Official account of the DataFun community, dedicated to sharing big data and AI industry summit news and speaker talks, with regular downloadable resource packs.
How this landed with the community
Was this worth your time?
0 Comments
Thoughtful readers leave field notes, pushback, and hard-won operational detail here.