The article explains the importance of data governance for organizations handling big data, outlines narrow and broad governance approaches, presents strategic design principles, and shares practical case studies from leading companies, while also offering a downloadable ebook of governance strategies.
This article explains the importance of data governance, distinguishes narrow and broad governance, outlines its systemic and selective nature, and presents eight practical case studies from companies like Tencent, NetEase, and MobTech, offering actionable strategies for high‑quality data across its lifecycle.
DataOps, the data‑centric counterpart of DevOps, combines agile principles, standardized tools, and cross‑team collaboration to manage the full data lifecycle—from integration and development to storage, governance, and service—enabling organizations to handle massive, diverse datasets efficiently, reduce silos, and turn data into actionable value.
This article outlines Baidu Intelligent Cloud's comprehensive, low‑cost solution for autonomous‑driving data pipelines—from road data collection and compliance, through annotation, management, and model training, to simulation—highlighting the platform's tools, services, and security measures that accelerate development.
This article examines the current state of financial data governance, outlines the external and internal drivers, presents a step‑by‑step architecture framework, discusses domain‑level coordination, shares practical implementations and Q&A, and highlights how AI and automation can enhance governance in the financial sector.
This article examines the four‑stage evolution of data warehouses, highlights the cost‑effective, scalable advantages of cloud‑native warehouses, explores the rapid growth of data‑management infrastructure, and discusses the emerging practices of DataOps and AI integration that are redefining modern data stacks.
The article presents NetEase Yidun’s data‑centric AI approach to content moderation, covering the background of Data‑Centric AI, the specific business and data challenges of content safety, comprehensive data pipelines—including collection, labeling, augmentation, selection, cleaning, iteration and testing—and the role of self‑, semi‑ and weak‑supervised learning in enhancing algorithm performance.
Data preparation consumes about 80% of the entire analytics workflow, making data collection, quality assurance, and governance critical pillars—spanning metadata, master data, storage layers like data lakes and warehouses, and rigorous preprocessing—to turn raw information into reliable insights.
This article introduces eleven widely used graphical tools for MySQL administration, describing each tool's features, platform support, and official download links, helping developers and DBAs choose the most suitable solution for managing MySQL databases efficiently.
This article explains what data architecture is, why it is essential for linking business and technology, outlines its main components such as data models, data flows, value streams and standards, and discusses emerging trends toward service‑oriented, consumption‑focused data architectures.
This article details State Grid Tianjin Electric Power's early adoption and successful certification of the national DCMM data management maturity model, outlining background, certification milestones, systematic practices, and lessons learned that illustrate how data governance, architecture, and application strategies drive digital transformation.
This article explains DataOps as a methodology for improving data analysis quality and efficiency, outlines its origins, standards, and maturity model, and presents practical insights and case studies from Chinese enterprises on how DataOps addresses common data engineering challenges and drives digital transformation.
This article explains the challenges of data lake adoption and details Alibaba Cloud’s metadata warehouse architecture, construction, search capabilities, asset analysis, fine‑grained profiling, and lifecycle management that together enable efficient, cloud‑native big data management.
Velox is Meta's open‑source unified execution engine that consolidates common data‑intensive components, integrates with engines like Presto, Spark, and TorchArrow, and delivers up to ten‑fold speedups on CPU‑bound queries while simplifying development and fostering a reusable, community‑driven ecosystem.
This article provides a comprehensive collection of SQL Server commands and techniques, covering database creation, table manipulation, queries, indexing, backup, replication, and advanced operations, offering practical examples and code snippets for developers and database administrators.
The author shares a candid account of transitioning from a non‑data role to confronting data‑centric bottlenecks, describing the current state of data projects, common pitfalls, and practical thoughts on simplifying data governance within limited resources and budget constraints.
The article explains data governance concepts, outlines four common governance models, details key policy elements such as availability, quality, integrity, usability, and security, and highlights the benefits, risks, and best‑practice recommendations for implementing effective data governance in organizations.
This article presents a cloud‑native redesign of Baidu's search middle‑platform that introduces intelligent data management, elastic scaling, on‑demand resource allocation, precise fan‑out, and localized computation to address efficiency, cost, stability, and performance challenges of large‑scale search workloads.
This article explains the evolution from traditional data warehouses to data lakes and the modern Lakehouse architecture, introduces Delta Lake's core concepts, multi‑hop medallion tables, ACID transactions, generated columns, standalone support, and future open‑source directions.
This article presents NetEase's big data platform architecture, detailing multi‑layer storage and compute design, HDFS deployment challenges, NameNode and NameSpace performance optimizations, cluster scaling strategies, data tiering, hardware upgrades, and real‑world business use cases, illustrating practical large‑scale big data engineering.
This article presents MobTech's comprehensive data governance and security practices, covering the necessity of governance, challenges in large‑scale data environments, the full‑link governance chain, modular architecture, and specific implementations for financial risk‑control scenarios.
This article provides a comprehensive overview of the Lakehouse paradigm, tracing its origins from traditional data warehouses and data lakes, comparing architectures, detailing core components such as Delta Lake and Iceberg, and illustrating practical cloud implementations and future directions.
This comprehensive article explains what a data lake is, its core characteristics, reference architecture, major cloud vendor implementations, typical use cases such as advertising and gaming, step‑by‑step construction guidance, and future trends in cloud‑native big‑data platforms.
Cloud-native redesign of Baidu's search middle platform introduces partition, shard, replica, and addressing controllers that enable elastic scaling, on-demand resource allocation, precise fan‑out, and localized computation, reducing capacity adjustment time from weeks to hours, cutting costs by 30‑80%, raising availability above 99.9% and halving query latency.
This article introduces the concept of a data map, explains its background and goals, describes Youzan’s end‑to‑end data‑map practice—including full data lineage, search, management, link analysis, impact estimation, and optimization—and concludes with a summary and future outlook.
This article presents a practical re‑design of the DAMA‑DMBOK data management framework, integrating Huawei's data approach and over a decade of governance experience, and details twelve knowledge domains with resources, examples, and guidance for building a comprehensive data governance system.
The article explains why the Internet of Things generates massive, diverse data streams that require specialized databases, outlines key selection criteria, describes common IoT data types, and reviews several open‑source databases—InfluxDB, CrateDB, MongoDB, RethinkDB, SQLite, and Cassandra—highlighting their strengths for IoT workloads.
The article explains how unstructured big data, often overlooked, should become a strategic focus, highlighting its massive unused value, the challenges of cataloging and moving petabyte‑scale datasets, and why agile cloud‑based storage is essential for modern enterprises.
The article outlines essential system‑oriented considerations for solution architects, covering data collection, transformation, storage, protection, information management, process orchestration, and reporting, and explains how these fundamentals vary across domains such as manufacturing execution systems and retail banking applications.
This article explains what data governance is, why it is needed, its objectives, core components, implementation methodology, required tools, and real‑world practices from Meituan Delivery and Ant Financial, illustrating how organized data management drives business value and risk control.
The article explains what a data lake is, its origins, key characteristics such as storing all raw data, flexible access, and low‑cost storage, compares it with traditional data warehouses, discusses advantages, common criticisms, and the types of users who can benefit from it.
This FAQ summarizes practical guidance for participants of the 2021 Tencent Advertising Algorithm Competition on using the TI-ONE cloud notebook platform, covering instance initialization, resource switching, data handling, common errors, and Git integration.
This article explains how the open‑source Fluid project addresses the inefficiencies of data‑intensive AI and big‑data workloads in cloud‑native Kubernetes environments by introducing a data‑centric abstraction, dual orchestration mechanisms, and seamless integration with Alluxio to achieve faster, secure, and scalable data access.
Learn ten practical strategies—from avoiding chat tools for SQL to using logical deletes, backups, and proper field management—to dramatically reduce the risk of costly database mishaps in production environments, ensuring safer data operations and easier recovery.
This article introduces DBeaver, a free open‑source, Java‑based universal database client that supports a wide range of databases via JDBC, outlines its rich features, and provides step‑by‑step installation and connection setup instructions for Windows, macOS, and Linux.
This article introduces DBeaver, a free open‑source, cross‑platform database management tool that supports numerous databases via JDBC, outlines its rich features such as data editors, ER diagrams, import/export, and provides step‑by‑step installation instructions for Windows, macOS, and Linux, plus tips for creating connections.
This article explains why data cleaning is essential for business success, outlines criteria for selecting data quality tools, discusses considerations for companies of different sizes, lists common tool features, and provides an overview of popular data quality vendors.
This article presents a Python console program that implements a graduate student information management system, providing basic CRUD operations such as viewing, adding, modifying, and deleting student records, and includes the full source code with menu-driven interaction.
IQ运营位 is a unified operational configuration platform for iQiyi’s overseas app that replaces costly, slow, inflexible marketing resource management with JSON‑modeled, versioned data stored across Redis caches, SDK‑driven client caching, and layered services, cutting deployment time to under five minutes while improving stability and scalability.
This article explains how JD’s JUST platform leverages the open‑source columnar database ClickHouse to store, query and analyze massive time‑series datasets, covering data modeling, lifecycle management, cluster architecture, write and query processes, scaling strategies and future enhancements.
The presentation outlines the AI engineering efficiency platform covering algorithm metric and evaluation, micro‑service performance testing, and dataset management architectures, detailing business pain points, platform‑wide improvements, technical designs, real‑world demos, and future directions to achieve accurate, fast, and stable AI services.
Explore the three pivotal stages of database development—from early manual management, through file-system storage, to modern database systems—highlighting their advantages, challenges, and the evolution of data independence, scalability, security, and integration with emerging technologies.
DataGrip, JetBrains' database IDE, supports most major relational databases and offers an intuitive interface for configuring connections, executing queries, editing data, creating tables, exporting/importing data, and leveraging advanced features such as keyword navigation, code completion, and result set filtering, making database management efficient.
Apache Calcite 1.25.0, a dynamic data management framework for Hadoop, has been released, introducing support for spatial functions and SQL interval expressions, removing deprecated methods from the previous version, and providing updated Maven dependency coordinates for the core library.
This article explores the concept of data quality, identifies ten common root causes, presents a comprehensive data quality management framework, outlines evaluation methods and key dimensions, and discusses future challenges and tools for improving data quality in large‑scale data environments.
This comprehensive article explains what a data lake is, outlines its core characteristics and reference architecture, compares major cloud providers' data‑lake offerings, presents typical advertising and gaming use cases, and proposes a practical, agile process for building and operating a data lake.
This article explores the evolution and monetization of operations data, outlines a four‑stage management process—from data discovery to modeling, ingestion, and monetization—highlights key scenarios such as intelligent monitoring and root‑cause analysis, and offers practical recommendations for building an effective ops data platform.
This article analyzes the Antd Form component's implementation, explaining how it collects, validates, and updates form data through rc-form's FieldsStore, and discusses advanced patterns like nested fields, custom component integration, and form linkage.
Youzan’s data governance system treats petabyte‑scale data as a strategic asset, employing comprehensive collection, standardized management, lineage tracing, quality monitoring, and security auditing, then quantifies asset value through grading and dashboards, and delivers actionable services such as impact analysis and notifications, while addressing onboarding costs and value evaluation challenges.
The article outlines a comprehensive data‑strategy framework for executives, highlighting business pressures, value, management, and data‑management considerations, and provides key questions to guide data discovery, business discovery, and the continual evolution of a practical, actionable data strategy.
The article provides a comprehensive overview of the Network Data Management Protocol (NDMP), explaining its architecture, core concepts, backup mechanisms, version differences, supported backup software, and various network topologies such as 2‑way, 3‑way, and remote configurations for efficient NAS data protection.
Master data refers to high‑value core business entities such as customers, products, and accounts that are shared across multiple systems, and master data management (MDM) provides the standards, technologies, and processes to collect, integrate, cleanse, govern, and distribute this data consistently throughout an organization, improving data quality, compliance, and agility.
The article explains the strategic importance of the Chief Data Officer role, outlining how CDOs drive data‑driven innovation through a four‑stage data supply chain—data supply, logistics, science, and execution—to create competitive advantage and business growth.
The article shares a DBA's real‑world experiences—from a risky MySQL restart that exposed hidden issues, through practical learning advice and MySQL technical nuances, to a detailed Oracle migration case—offering actionable insights for database professionals seeking robust data management and performance optimization.
Based on a 2017 Stack Overflow survey of 64,000 developers, this article explains why SQL remains the second‑most used programming language, detailing eight technical, community‑driven and practical reasons that keep relational databases indispensable despite the rise of newer technologies.
This article introduces the concept, origins, technical background, classifications, and future directions of software-defined storage (SDS), while recommending the book “Software-Defined Storage: Principles, Practices, and Ecosystem” as a comprehensive guide for practitioners and enthusiasts.
Enterprises can unlock Hadoop's full potential by following five strategic steps—from defining high‑impact use cases and assessing architectural fit to managing data, integrating systems, and addressing skill gaps—ensuring measurable business value and competitive advantage.
The article explains the rapid growth of unstructured data, outlines typical sources and management challenges, and details how KingbaseES’s full‑text indexing, extensible ranking, and large‑object support (BLOB/CLOB up to 2 GB) enable efficient storage, retrieval, and processing of such data.
The article explains how Copy Data Virtualization technology, exemplified by Actifio, consolidates Oracle and VMware data backup, disaster recovery, and development testing into a single platform, reducing production load, storage costs, and recovery time while providing incremental, always‑on data copies.
This article examines the key challenges of building large‑scale, high‑interaction web 2.0 platforms—including massive data processing, concurrency control, file storage, indexing, distributed architecture, AJAX usage, security, synchronization, clustering, and OpenAPI integration—offering practical considerations for robust backend design.
This article reviews the evolution of big‑data management technologies, discusses the criteria for choosing appropriate big‑data benchmarks, compares existing benchmarks such as MapReduce tests, YCSB, BigBench and BigFrame, and provides an in‑depth analysis of the TPC‑DS benchmark and its certification status.
Apache Geode is an open‑source, real‑time, consistent data management platform for large distributed cloud environments, offering high availability, scalability, and low‑latency data access; this article explains its architecture, key components, features, and provides a step‑by‑step 5‑minute setup with sample Java client code.
