Tagged articles

data lifecycle

27 articles · Page 1 of 1
Smart Sea Tide
Smart Sea Tide
Dec 5, 2025 · Big Data

Understanding Data Lineage: Concepts, Characteristics, and Practical Collection Methods

The article explains data lineage as the full‑lifecycle relationships between data objects, outlines its ownership, multi‑source, traceability, and hierarchical traits, illustrates with school and banking examples, and details why lineage is crucial for compliance, impact analysis, security, migration, and self‑service, while reviewing collection techniques.

Big DataData GovernanceETL
0 likes · 11 min read
Understanding Data Lineage: Concepts, Characteristics, and Practical Collection Methods
Big Data Tech Team
Big Data Tech Team
Nov 2, 2025 · Big Data

Data Governance Blueprint: Naming Rules, Lifecycle Levels, and Layered Architecture

Explore a comprehensive data governance guide covering naming conventions, data lifecycle classifications, layered architecture standards, inter-layer calling rules, and model design principles, providing practical standards and best practices for building robust, maintainable data warehouses and analytics platforms.

Data WarehouseModel Designdata lifecycle
0 likes · 9 min read
Data Governance Blueprint: Naming Rules, Lifecycle Levels, and Layered Architecture
Subtle Storm
Subtle Storm
Jun 4, 2025 · Cloud Computing

OSS: The Giant Wheel Powering Cloud Object Storage

The article provides a detailed technical overview of Alibaba Cloud's Object Storage Service (OSS), covering its architecture, features such as massive scalability, lifecycle management, versioning, cross‑region replication, security mechanisms, access methods, and common use cases like static website hosting, big‑data analytics, backup, and multimedia processing.

Alibaba CloudCloud Computingdata lifecycle
0 likes · 8 min read
OSS: The Giant Wheel Powering Cloud Object Storage
Data Integration and Governance
Data Integration and Governance
Mar 28, 2025 · Big Data

What Does Data Governance Actually Do? A Data‑Quality Perspective

The article explains that data governance is a systematic combination of mechanisms, processes, platforms and capabilities focused on data quality, outlines an eight‑step quality workflow, defines eight quality dimensions, describes six concrete business values, and compares governance with the data middle‑platform concept.

Data GovernanceData Managementdata lifecycle
0 likes · 12 min read
What Does Data Governance Actually Do? A Data‑Quality Perspective
Data Thinking Notes
Data Thinking Notes
Aug 12, 2024 · Information Security

Understanding Data Governance vs Data Security Governance: Key Frameworks Explained

This article explains how data has become a strategic resource, outlines the economic and industrial value of data, differentiates data governance from data security governance, and reviews major data security frameworks and a data‑centric security architecture to guide organizations in protecting their data assets.

Data Governancedata lifecycledata security
0 likes · 12 min read
Understanding Data Governance vs Data Security Governance: Key Frameworks Explained
Data Thinking Notes
Data Thinking Notes
Jul 16, 2024 · Information Security

How to Build an Effective Data Security Operations Metrics System

Data security, centered on the full data lifecycle, demands deep defense against dynamic, continuous risks; by adopting a new operational mindset and a comprehensive metrics system, organizations can achieve greater visibility, control, sustainability, and trustworthiness in protecting their data assets.

data lifecycledata securityinformation security
0 likes · 3 min read
How to Build an Effective Data Security Operations Metrics System
DataFunSummit
DataFunSummit
Jun 3, 2024 · Big Data

Data Governance and Active Metadata Practices at JD Retail

The article outlines JD Retail's data management challenges—including asset awareness, architectural agility, development quality, and rising resource costs—and presents a comprehensive data governance framework that leverages data standards, agile architecture, development isolation, resource optimization, and active metadata to achieve intelligent lifecycle evaluation, automated back‑fill, and future‑oriented data fabric improvements.

Data Governanceactive metadatadata lifecycle
0 likes · 18 min read
Data Governance and Active Metadata Practices at JD Retail
Tencent Cloud Middleware
Tencent Cloud Middleware
Dec 12, 2023 · Cloud Native

How Tencent Cloud Implements Tiered Storage for Kafka: Architecture, Challenges, and Evolution

This article examines the challenges of Kafka's traditional architecture, explains why local‑state heavy deployments cause operational difficulty and resource waste, and details Tencent Cloud's elastic, storage‑compute‑separated designs—including tiered storage, segment state machines, offset constraints, and performance optimizations—while sharing practical implementation insights and future directions.

Cloud NativeElastic ArchitectureKafka
0 likes · 17 min read
How Tencent Cloud Implements Tiered Storage for Kafka: Architecture, Challenges, and Evolution
DataFunTalk
DataFunTalk
Dec 5, 2023 · Big Data

Design and Practice of Xiaomi’s One‑Stop Data Production Platform

This article presents a comprehensive overview of Xiaomi’s data production platform, detailing the full data lifecycle, the technical‑driven product design methodology, the platform’s architecture and core capabilities, as well as real‑world case studies and a Q&A session that illustrate how the system improves data collection, storage, processing, and usage across the organization.

Data EngineeringETLdata lifecycle
0 likes · 17 min read
Design and Practice of Xiaomi’s One‑Stop Data Production Platform
Architects Research Society
Architects Research Society
Nov 12, 2023 · Fundamentals

Why Data Lifecycle Processes Are Crucial for an Outcome‑Driven Enterprise Data Strategy

The article explains how well‑designed data lifecycle processes—including simple, automated CRUD workflows and dedicated data stewards—are essential for managing growing data volumes, ensuring data quality, complying with regulations, and ultimately supporting outcome‑driven enterprise data strategies.

CRUDProcess Automationdata lifecycle
0 likes · 7 min read
Why Data Lifecycle Processes Are Crucial for an Outcome‑Driven Enterprise Data Strategy
Data Thinking Notes
Data Thinking Notes
Aug 30, 2023 · Fundamentals

Mastering Data Governance: A Complete Guide to Metadata, Standards, Quality, and Security

Data governance encompasses a comprehensive framework—including metadata, master data, standards, quality, assets, exchange, security, and lifecycle management—to ensure data’s accuracy, consistency, and value across an organization, offering step‑by‑step guidance, best‑practice models, and visual references for effective implementation.

Data Governancedata lifecycledata quality
0 likes · 19 min read
Mastering Data Governance: A Complete Guide to Metadata, Standards, Quality, and Security
政采云技术
政采云技术
Feb 14, 2023 · Fundamentals

Understanding Indicator Systems: Definitions, Lifecycle, and Construction Methodology

This article explains the concept of indicator systems, distinguishes result and process metrics, outlines their lifecycle stages, and details a step‑by‑step methodology for designing, naming, modeling, and productizing a comprehensive metric framework to support data‑driven business decisions.

Business IntelligenceIndicator Systemdata lifecycle
0 likes · 13 min read
Understanding Indicator Systems: Definitions, Lifecycle, and Construction Methodology
Architects Research Society
Architects Research Society
Jan 5, 2023 · Fundamentals

Key Solution Architecture Focus Areas During a Project

The article outlines essential solution‑architecture considerations for complex ICT projects, covering digital data handling, information lifecycle management, process execution and orchestration, as well as reporting, and emphasizes how these fundamentals vary across domains such as manufacturing, banking, and cloud‑based systems.

Process Orchestrationdata lifecycleinformation management
0 likes · 10 min read
Key Solution Architecture Focus Areas During a Project
Code Ape Tech Column
Code Ape Tech Column
Jan 24, 2022 · Databases

Hot and Cold Data Separation: Concepts, Scenarios, and Implementation Methods

The article explains the hot‑cold data separation pattern, describing its purpose, when to use it, how to distinguish hot versus cold data, and three practical implementation approaches—code modification, binlog listening, and scheduled scanning—to improve performance and maintain data consistency in large‑scale systems.

Cold DataHot Datadata lifecycle
0 likes · 10 min read
Hot and Cold Data Separation: Concepts, Scenarios, and Implementation Methods
DataFunTalk
DataFunTalk
Jan 18, 2022 · Information Security

Data Security Governance: Concepts, Goals, Tool Framework, and Practices

This presentation introduces data security concepts, outlines security goals and the 4A/5A model, describes the data lifecycle, and details practical tools and frameworks for identity authentication, access control, asset protection, and comprehensive governance to ensure secure data handling across its full lifecycle.

access controldata lifecycledata security
0 likes · 16 min read
Data Security Governance: Concepts, Goals, Tool Framework, and Practices
Architects Research Society
Architects Research Society
Oct 19, 2021 · Fundamentals

Data Lifecycle Diagram and Business Entity State Modeling

The article explains how data lifecycle diagrams model business data independently of processes, define stable entity states and transitions, and illustrate these concepts with a UML/BPMN EAP profile example of an order entity, while also providing community and resource links.

BPMNUMLbusiness entity
0 likes · 6 min read
Data Lifecycle Diagram and Business Entity State Modeling
Big Data Technology Architecture
Big Data Technology Architecture
Mar 25, 2021 · Big Data

Implementing Erasure Coding in HDFS: Migration, Testing, and Data Lifecycle Management at JD

This article details JD's end‑to‑end implementation of HDFS erasure coding, covering the migration from replication to EC, the three‑phase upgrade and rollback process, comprehensive automated testing, a custom data‑lifecycle management system for hot‑warm‑cold data, and multi‑layer integrity safeguards to achieve significant storage cost reduction while maintaining reliability.

HDFSdata lifecycleerasure-coding
0 likes · 17 min read
Implementing Erasure Coding in HDFS: Migration, Testing, and Data Lifecycle Management at JD
Big Data Technology & Architecture
Big Data Technology & Architecture
Jun 16, 2020 · Big Data

Hot and Cold Data Separation in Big Data Systems

The article explains the concept of hot and cold data, why separating them reduces cost, and presents heterogeneous and homogeneous architectural solutions—including Elasticsearch, HBase, AWS S3, and cloud‑based UltraWarm—illustrated with network‑behavior and e‑commerce order system case studies.

AWS S3Big Data ArchitectureCold Data
0 likes · 11 min read
Hot and Cold Data Separation in Big Data Systems
Efficient Ops
Efficient Ops
Oct 18, 2018 · Cloud Computing

How OpenSDS Is Transforming Multi‑Cloud Storage Management

This article explains how OpenSDS, an open‑source Software‑Defined Storage project, standardizes storage virtualization, simplifies traditional data‑center operations, and enables unified, vendor‑neutral data management across multi‑cloud environments while outlining its technical architecture and future roadmap.

Multi-CloudOpenSDSSoftware-Defined Storage
0 likes · 7 min read
How OpenSDS Is Transforming Multi‑Cloud Storage Management
UCloud Tech
UCloud Tech
Jul 11, 2018 · Cloud Computing

Ceph-Powered Hybrid Cloud Storage: Performance, Cost, and Security Insights

The article examines public and private cloud storage trade‑offs, introduces hybrid cloud storage with Ceph, details RGW Multisite and Cloud Sync mechanisms, highlights their limitations, and presents the UMStor solution that adds fine‑grained storage classes, lifecycle management, and automated migration policies for cost‑effective, high‑performance, secure data handling.

cloud syncdata lifecyclehybrid-cloud
0 likes · 15 min read
Ceph-Powered Hybrid Cloud Storage: Performance, Cost, and Security Insights