BestHub
search
Sign in
Tag

data archiving

1 views collected around this technical thread.

Architect's Guide
Architect's Guide
Feb 4, 2024 · Databases

Evaluating Large MySQL Table Size and Optimizing Query Performance with Partitioning, Sharding, and Archiving

This article explains how to assess MySQL table size through table capacity, disk usage, and instance resources, illustrates the impact of B+‑tree index depth on query speed, and presents three practical solutions—table partitioning, database sharding, and hot‑cold data archiving—to improve performance.

B-TreeDatabase OptimizationSharding
0 likes · 15 min read
Evaluating Large MySQL Table Size and Optimizing Query Performance with Partitioning, Sharding, and Archiving
Efficient Ops
Efficient Ops
Jan 8, 2024 · Databases

Eight Proven Strategies to Supercharge Database Performance

This article outlines why databases become slow, introduces a four‑layer optimization framework, and presents eight practical solutions—including data reduction, archiving, sharding, caching, and read‑replica strategies—to help engineers systematically diagnose and resolve the majority of performance bottlenecks.

CQRSCachingDatabase Optimization
0 likes · 20 min read
Eight Proven Strategies to Supercharge Database Performance
DataFunTalk
DataFunTalk
Sep 22, 2023 · Big Data

Design and Practice of Baidu's Tape Library Storage Architecture Based on the Aries Cloud Storage System

This article presents a comprehensive overview of Baidu Intelligent Cloud's tape‑library solution, detailing tape and tape‑library fundamentals, the Aries cloud storage stack, data and access models, the end‑to‑end data flow, key architectural design choices, implementation details, and a real‑world case study demonstrating large‑scale cold‑data storage, backup, and retrieval performance.

AriesCold DataDistributed Storage
0 likes · 28 min read
Design and Practice of Baidu's Tape Library Storage Architecture Based on the Aries Cloud Storage System
vivo Internet Technology
vivo Internet Technology
May 24, 2023 · Big Data

Kafka Real-time Data Archiving to Hive: Flink SQL and DataStream Implementation Solutions

The article explains how to archive Kafka real‑time data to Hive using either Flink SQL, which quickly creates partitioned ORC tables but requires timezone handling, or Flink DataStream for more complex pipelines, and offers best‑practice guidance on data quality, system complexity, security, and performance.

DataStreamFlinkFlink SQL
0 likes · 15 min read
Kafka Real-time Data Archiving to Hive: Flink SQL and DataStream Implementation Solutions
Top Architect
Top Architect
Mar 14, 2023 · Databases

Handling Large MySQL Tables: Partitioning, Sharding, and Archiving Strategies

This article explains how to assess MySQL table size, identify performance issues caused by massive data volumes, and presents three practical solutions—table partitioning, database sharding, and hot‑cold data archiving—along with detailed SQL examples and considerations for implementation.

Performance OptimizationShardingdata archiving
0 likes · 16 min read
Handling Large MySQL Tables: Partitioning, Sharding, and Archiving Strategies
Top Architect
Top Architect
Mar 4, 2023 · Databases

How to Handle Large MySQL Tables: Partitioning, Sharding, and Archiving Strategies

This article explains why large MySQL tables cause slow queries, analyzes table size, disk usage, and instance capacity, and presents three practical solutions—table partitioning, database sharding (horizontal/vertical), and hot‑cold data archiving—helping developers choose the appropriate strategy for their workloads.

Performance OptimizationShardingdata archiving
0 likes · 18 min read
How to Handle Large MySQL Tables: Partitioning, Sharding, and Archiving Strategies
Selected Java Interview Questions
Selected Java Interview Questions
May 6, 2022 · Databases

Eight Database Optimization Strategies for Performance Improvement

This article presents a systematic overview of eight practical database optimization techniques—including data reduction, serialization, archiving, intermediate tables, sharding, distributed caching, master‑slave replication, and appropriate storage selection—to help backend engineers diagnose and resolve the majority of performance bottlenecks caused by data volume, high load, and search complexity.

CQRSCachingDatabase Optimization
0 likes · 19 min read
Eight Database Optimization Strategies for Performance Improvement
Aikesheng Open Source Community
Aikesheng Open Source Community
Mar 17, 2022 · Databases

Real-World MySQL Time-Based Partitioning Case Study: Table Optimization Process

This article presents a detailed case study of optimizing a massive MySQL table using time‑based partitioning, describing the problem background, partition design, migration scripts, performance benchmarks, and ongoing maintenance procedures for a ten‑year data archive.

Database OptimizationPerformanceSQL
0 likes · 13 min read
Real-World MySQL Time-Based Partitioning Case Study: Table Optimization Process
DevOps
DevOps
Dec 10, 2020 · Fundamentals

GitHub’s Arctic Code Vault and Future Glass Storage for Open Source Code

GitHub’s Arctic Code Vault initiative has archived millions of open‑source projects on film stored in a Norwegian Arctic facility, and the company now plans to preserve code for millennia using quartz glass through Microsoft’s Project Silica, highlighting long‑term data preservation strategies for software.

Arctic Code VaultGitHubProject Silica
0 likes · 4 min read
GitHub’s Arctic Code Vault and Future Glass Storage for Open Source Code