BestHub
Sign in
Tagged articles

metadata

217 articles · Page 3 of 3
Tencent Database Technology
Tencent Database Technology
Mar 12, 2019 · Databases

Understanding MySQL 8.0 Data Dictionary, Atomic DDL, and Persistent Autoincrement

This article explains the evolution of MySQL's data dictionary from pre‑8.0 scattered metadata to the unified InnoDB dictionary tables in MySQL 8.0, covering storage structures, dictionary caching, information_schema changes, serialized dictionary information (SDI), atomic DDL mechanisms, persistent autoincrement handling, upgrade considerations, and provides practical code examples.

Atomic DDLInnoDBMySQL
0 likes · 22 min read
Understanding MySQL 8.0 Data Dictionary, Atomic DDL, and Persistent Autoincrement
Efficient Ops
Efficient Ops
Mar 3, 2019 · Fundamentals

How Journal File Systems Prevent Data Loss After Crashes

Journal file systems protect against data corruption caused by power loss or crashes by recording each write operation as a transaction in a dedicated log, then committing the changes only after the log is safely stored, enabling replay to restore consistency.

Data ConsistencyFile SystemWrite-Ahead Logging
0 likes · 6 min read
How Journal File Systems Prevent Data Loss After Crashes
Java Backend Technology
Java Backend Technology
Feb 27, 2019 · Backend Development

Revamping Dubbo Service Governance: Inside the New Dubbo Admin 0.1

Dubbo Admin 0.1, a freshly refactored standalone project, replaces the old Webx backend with Spring Boot, adopts Vue and Vuetify for the UI, integrates Swagger, and introduces updated configuration, tag routing, application‑level service governance, and metadata‑driven testing to fully support Dubbo 2.7 features.

ConfigurationDubboService Governance
0 likes · 8 min read
Revamping Dubbo Service Governance: Inside the New Dubbo Admin 0.1
Architects' Tech Alliance
Architects' Tech Alliance
Oct 15, 2018 · Databases

Data Sharding in Distributed Systems: Partitioning Strategies, Metadata Management, and Consistency Mechanisms

The article explains how distributed storage systems solve the fundamental problems of data sharding and redundancy by describing three sharding methods (hash, consistent‑hash, and range‑based), the criteria for choosing a shard key, the role of metadata servers, and consistency techniques such as leasing, all illustrated with concrete examples and code snippets.

consistent hashingdatabasesdistributed systems
0 likes · 25 min read
Data Sharding in Distributed Systems: Partitioning Strategies, Metadata Management, and Consistency Mechanisms
dbaplus Community
dbaplus Community
Sep 27, 2018 · Databases

How We Built an Automated DBA Platform: Architecture, Design, and Lessons

This article outlines the journey of a financial services company from manual DBA tasks through tool‑assisted operations to a fully automated platform, detailing the platform’s technical stack, functional modules, metadata design principles, evolving SQL audit workflow, and future directions for intelligent database operations.

DBAPlatformSQL Auditing
0 likes · 17 min read
How We Built an Automated DBA Platform: Architecture, Design, and Lessons
Youzan Coder
Youzan Coder
Sep 15, 2018 · Big Data

How Data Empowers Operations: Insights from Youzan & NetEase’s Big Data Summit

On September 15, Youzan’s big-data team and NetEase YouShu hosted a technical sharing titled “The Road to Data-Driven Operations,” where speakers explored the evolution of Youzan’s data warehouse metadata system, the architecture of its big-data development platform, and the application of functional programming in visual data analysis, highlighting current trends and future directions.

Data VisualizationPlatform Architecturedata warehouse
0 likes · 4 min read
How Data Empowers Operations: Insights from Youzan & NetEase’s Big Data Summit
ITPUB
ITPUB
Sep 30, 2017 · Big Data

Designing Scalable Open‑Source ETL Systems: Lessons from Baidu Waimai

This talk details Baidu Waimai's end‑to‑end ETL design, covering demand sources, data flow patterns, multi‑stage system evolution, storage choices, scheduling architecture, configuration‑driven processing, quality monitoring, and how data lineage enables transparent, self‑service data delivery.

Data PipelineData QualityETL
0 likes · 25 min read
Designing Scalable Open‑Source ETL Systems: Lessons from Baidu Waimai
ITPUB
ITPUB
Sep 29, 2017 · Big Data

Designing an Open ETL System: Baidu Waimai’s Scalable Data Pipeline Practices

In this talk, a Baidu Waimai engineer explains the motivations, requirements, and architectural choices behind their open‑source ETL platform, covering data flow patterns, logical mappings, storage options, scheduling, metadata management, and quality monitoring to achieve scalable, transparent, and explainable data delivery.

Data PipelineETLbig data
0 likes · 26 min read
Designing an Open ETL System: Baidu Waimai’s Scalable Data Pipeline Practices
21CTO
21CTO
Aug 4, 2017 · Artificial Intelligence

AI Behind Hulu's Video Recommendations: From Collaborative Filtering to Neural Nets

In this talk, Hulu’s research director Zhou Hanning explains the key factors influencing recommendation system performance, describes optimization goals, explores collaborative filtering, matrix factorization, and neural‑network approaches—including metadata‑driven transfer learning and cold‑start solutions for live streaming—and shares practical AI implementations that improve user experience and engagement.

AIcold startmetadata
0 likes · 10 min read
AI Behind Hulu's Video Recommendations: From Collaborative Filtering to Neural Nets
Architect
Architect
Apr 19, 2017 · Fundamentals

Analysis of Ceph Bluestore Storage Engine Architecture

This article examines Ceph's Bluestore storage engine, describing its raw‑device management, metadata structures, write and read I/O processing, allocation strategies, and clone handling, highlighting how it reduces write amplification and optimizes for SSDs compared to the older Filestore.

BlueStoreCephI/O Architecture
0 likes · 9 min read
Analysis of Ceph Bluestore Storage Engine Architecture
Architecture Digest
Architecture Digest
Apr 15, 2016 · Operations

Google's Midas Package Manager (MPM): Architecture, Build Process, and Security Features

The article explains Google’s internal Midas Package Manager (MPM), detailing its build definition files, immutable and mutable metadata stored in Bigtable, distributed replication via Colossus, client‑side pull and P2P copying, as well as its access‑control, encryption, and signing mechanisms that enable massive, conflict‑free software deployment at Google’s scale.

GoogleMPMmetadata
0 likes · 11 min read
Google's Midas Package Manager (MPM): Architecture, Build Process, and Security Features
dbaplus Community
dbaplus Community
Dec 16, 2015 · Databases

Understanding Oracle ASM Metadata: Files, AU, Disk Headers, and Recovery

This article explains Oracle ASM metadata concepts, including ASM file types, allocation units, physical and virtual metadata structures, disk header composition, and practical methods for querying, validating, backing up, and restoring ASM metadata using tools like KFOD, KFED, and X$KFFXP.

ASMAllocation UnitDisk Header
0 likes · 14 min read
Understanding Oracle ASM Metadata: Files, AU, Disk Headers, and Recovery
Art of Distributed System Architecture Design
Art of Distributed System Architecture Design
Aug 5, 2015 · Databases

Challenges and Strategies for Metadata Protection in Cloud Object Storage

This article examines the problems and trade‑offs of metadata protection in cloud object storage, highlighting the importance of reliability, availability, and consistency, and comparing primary‑secondary and multi‑replica models, including the WRN algorithm and practical operational considerations.

Object StorageReplicationWRN algorithm
0 likes · 28 min read
Challenges and Strategies for Metadata Protection in Cloud Object Storage