BestHub
Sign in
Tagged articles

Metadata

213 articles · Page 3 of 3
Architects' Tech Alliance
Architects' Tech Alliance
Oct 15, 2018 · Databases

Data Sharding in Distributed Systems: Partitioning Strategies, Metadata Management, and Consistency Mechanisms

The article explains how distributed storage systems solve the fundamental problems of data sharding and redundancy by describing three sharding methods (hash, consistent‑hash, and range‑based), the criteria for choosing a shard key, the role of metadata servers, and consistency techniques such as leasing, all illustrated with concrete examples and code snippets.

DatabasesMetadataSharding
0 likes · 25 min read
Data Sharding in Distributed Systems: Partitioning Strategies, Metadata Management, and Consistency Mechanisms
dbaplus Community
dbaplus Community
Sep 27, 2018 · Databases

How We Built an Automated DBA Platform: Architecture, Design, and Lessons

This article outlines the journey of a financial services company from manual DBA tasks through tool‑assisted operations to a fully automated platform, detailing the platform’s technical stack, functional modules, metadata design principles, evolving SQL audit workflow, and future directions for intelligent database operations.

AutomationDBADatabases
0 likes · 17 min read
How We Built an Automated DBA Platform: Architecture, Design, and Lessons
Youzan Coder
Youzan Coder
Sep 15, 2018 · Big Data

How Data Empowers Operations: Insights from Youzan & NetEase’s Big Data Summit

On September 15, Youzan’s big-data team and NetEase YouShu hosted a technical sharing titled “The Road to Data-Driven Operations,” where speakers explored the evolution of Youzan’s data warehouse metadata system, the architecture of its big-data development platform, and the application of functional programming in visual data analysis, highlighting current trends and future directions.

Data VisualizationData WarehouseFunctional Programming
0 likes · 4 min read
How Data Empowers Operations: Insights from Youzan & NetEase’s Big Data Summit
ITPUB
ITPUB
Sep 30, 2017 · Big Data

Designing Scalable Open‑Source ETL Systems: Lessons from Baidu Waimai

This talk details Baidu Waimai's end‑to‑end ETL design, covering demand sources, data flow patterns, multi‑stage system evolution, storage choices, scheduling architecture, configuration‑driven processing, quality monitoring, and how data lineage enables transparent, self‑service data delivery.

Big DataData PipelineData Warehouse
0 likes · 25 min read
Designing Scalable Open‑Source ETL Systems: Lessons from Baidu Waimai
ITPUB
ITPUB
Sep 29, 2017 · Big Data

Designing an Open ETL System: Baidu Waimai’s Scalable Data Pipeline Practices

In this talk, a Baidu Waimai engineer explains the motivations, requirements, and architectural choices behind their open‑source ETL platform, covering data flow patterns, logical mappings, storage options, scheduling, metadata management, and quality monitoring to achieve scalable, transparent, and explainable data delivery.

Big DataData EngineeringData Pipeline
0 likes · 26 min read
Designing an Open ETL System: Baidu Waimai’s Scalable Data Pipeline Practices
21CTO
21CTO
Aug 4, 2017 · Artificial Intelligence

AI Behind Hulu's Video Recommendations: From Collaborative Filtering to Neural Nets

In this talk, Hulu’s research director Zhou Hanning explains the key factors influencing recommendation system performance, describes optimization goals, explores collaborative filtering, matrix factorization, and neural‑network approaches—including metadata‑driven transfer learning and cold‑start solutions for live streaming—and shares practical AI implementations that improve user experience and engagement.

AIMetadataRecommendation Systems
0 likes · 10 min read
AI Behind Hulu's Video Recommendations: From Collaborative Filtering to Neural Nets
Architect
Architect
Apr 19, 2017 · Fundamentals

Analysis of Ceph Bluestore Storage Engine Architecture

This article examines Ceph's Bluestore storage engine, describing its raw‑device management, metadata structures, write and read I/O processing, allocation strategies, and clone handling, highlighting how it reduces write amplification and optimizes for SSDs compared to the older Filestore.

BlueStoreCephI/O Architecture
0 likes · 9 min read
Analysis of Ceph Bluestore Storage Engine Architecture
Architecture Digest
Architecture Digest
Apr 15, 2016 · Operations

Google's Midas Package Manager (MPM): Architecture, Build Process, and Security Features

The article explains Google’s internal Midas Package Manager (MPM), detailing its build definition files, immutable and mutable metadata stored in Bigtable, distributed replication via Colossus, client‑side pull and P2P copying, as well as its access‑control, encryption, and signing mechanisms that enable massive, conflict‑free software deployment at Google’s scale.

GoogleMPMMetadata
0 likes · 11 min read
Google's Midas Package Manager (MPM): Architecture, Build Process, and Security Features
dbaplus Community
dbaplus Community
Dec 16, 2015 · Databases

Understanding Oracle ASM Metadata: Files, AU, Disk Headers, and Recovery

This article explains Oracle ASM metadata concepts, including ASM file types, allocation units, physical and virtual metadata structures, disk header composition, and practical methods for querying, validating, backing up, and restoring ASM metadata using tools like KFOD, KFED, and X$KFFXP.

ASMAllocation UnitBackup
0 likes · 14 min read
Understanding Oracle ASM Metadata: Files, AU, Disk Headers, and Recovery
Art of Distributed System Architecture Design
Art of Distributed System Architecture Design
Aug 5, 2015 · Databases

Challenges and Strategies for Metadata Protection in Cloud Object Storage

This article examines the problems and trade‑offs of metadata protection in cloud object storage, highlighting the importance of reliability, availability, and consistency, and comparing primary‑secondary and multi‑replica models, including the WRN algorithm and practical operational considerations.

MetadataOperationsWRN algorithm
0 likes · 28 min read
Challenges and Strategies for Metadata Protection in Cloud Object Storage