Drawing from a year‑and‑a‑half of ops experience, this guide outlines six practical categories—online operation standards, data handling, security, daily monitoring, performance tuning, and mindset—to help engineers avoid costly mistakes and maintain stable, secure systems.
This article explains what raw (裸) devices are, how to identify and use them with Oracle on Unix, their performance advantages, when they should be employed, and practical tips for configuration, backup, and related storage considerations.
This article details the design, automation, high‑availability architecture, backup strategy, and operational workflow of the HULK private‑cloud MySQL service, covering instance provisioning, table management, testing environments, optimization tips, data recovery, and future plans.
This article provides a comprehensive, step‑by‑step guide on MySQL backup strategies, security hardening, SQL coding standards, and system planning, offering practical recommendations, verification methods, and actionable checklists to help DBAs build resilient and well‑managed database environments.
This guide explains how to use SRVCTL to view the status of Oracle RAC databases, instances, services, node applications, and ASM instances, retrieve configuration details, start and stop the cluster, and perform backup and restore operations with concrete command examples.
After a mistaken rm -rf command wiped an entire production server—including MySQL data—the author chronicles a step‑by‑step recovery using ext3grep, custom scripts, and binlog restoration, highlighting lessons learned and best practices for future incident handling.
This article explains RAID fundamentals, compares common RAID levels, shows how to identify the configured RAID using MegaCli, evaluates write policies and battery status, and recommends optimal RAID configurations for MySQL data, binary logs, and redo files.
This guide explains MySQL backup fundamentals, comparing cold backups, LVM snapshot backups, logical tools like mysqldump and mydumper, and physical solutions such as Percona Xtrabackup, detailing each method’s workflow, advantages, limitations, and how to achieve consistent recovery points and times.
This guide shares a senior DBA’s hard‑learned lessons on mastering MySQL environments, ensuring data security, handling routine operations, designing robust architectures, and adopting the right mindset to reduce costly mistakes and improve reliability in production systems.
This guide explains how to restore an accidentally dropped MySQL database by leveraging nightly full backups and incremental binlog files, detailing the required configuration, command usage, and step‑by‑step procedures to safely recover lost data.
This guide outlines the ten core toolsets—ranging from Linux basics and network services to scripting, firewalls, monitoring, clustering, and backup—that aspiring Linux operations engineers need to master for effective system administration.
WeChat’s WCDB component tackles pervasive SQLite corruption on mobile devices by combining dump‑based, backup, and B‑tree parsing recovery methods, achieving up to 78% success while supporting encrypted databases, large data volumes, and seamless user experience.
This guide walks through the most common MySQL backup methods—including mysqldump, mysqlbackup, mysqlhotcopy, and Percona XtraBackup—detailing command syntax, options, lock behavior, restoration steps, and practical examples for both logical and physical backups.
This article presents two comprehensive Shell scripts—one to validate Oracle RMAN backup sets and another to perform a full backup‑restore experiment—detailing SSH trust configuration, source information collection, log transfer, directory preparation, and step‑by‑step RMAN restore commands, all illustrated with practical screenshots and a GitHub repository link.
This tutorial walks through essential MySQL command-line operations on Linux, covering database connection, creation, deletion, backup strategies, restoration, renaming, and detailed table manipulation such as creating, modifying, and querying data.
Facing a 0.02% SQLite corruption rate that threatened years of chat history, the WeChat mobile team identified three main causes—insufficient space, power loss, and sync failures—and implemented space management, full sync settings, and master‑table backups, halving damage and doubling repair success.
This guide outlines nine practical MySQL recovery methods—including full backup with binlog, business‑logic rollback, flashback tools, innodb_force_recovery, tablespace discard/import, manual ibd editing, extundelete, and Percona's recovery utility—to help DBAs restore data after accidental deletions, corruption, or hardware failures.
WeChat reduced its SQLite chat‑record corruption rate by over 50% by optimizing storage space, enforcing full file synchronization (including iOS fullfsync), and implementing a dual‑backup strategy for the master table with CRC checks and pre‑allocated space, dramatically improving repair success.
This article outlines practical steps DBAs can take to prevent data leakage and loss, covering user and profile management, privilege minimization, audit logging, vulnerability patching, high‑availability solutions like RAC and Data Guard, and effective backup and recovery drills.
This guide explains how to use Percona XtraBackup for fast single‑table recovery in both local full‑backup and remote streaming scenarios, detailing preparation steps, command examples, and essential configuration tweaks to minimize downtime and data loss.
This article provides a comprehensive overview of backup concepts, various backup architectures such as Host, LAN, LAN‑free, Server‑free and Server‑less, evaluates leading enterprise backup solutions, and analyzes key features like deduplication, NDMP support, OS compatibility and maintainability.
This article outlines the five evolutionary stages of a MySQL deployment—table design, deployment, performance tuning, architecture scaling, and maintenance—detailing practical configuration tweaks, kernel and hardware optimizations, replication strategies, caching, sharding, partitioning, and essential monitoring and backup techniques.
This article explains why Redis data must be persisted, compares the two built‑in methods—RDB snapshotting and Append‑Only File (AOF)—and provides practical configuration tips, command usage, performance considerations, and verification tools for reliable backup and recovery.
The article reflects on the GitLab database deletion incident, analyzing how human error, decision fatigue, inadequate backup strategies, and insufficient safeguards exposed reliability gaps, and proposes practical DevOps practices—such as pair operations, diversified redundancy, strict command restrictions, and continuous feedback—to strengthen complex software systems.
The article recounts a GitLab production database deletion caused by a mistaken command, analyzes why the backup mechanisms failed, and offers technical and cultural recommendations—including automation, proper replication, and transparent post‑mortems—to build more reliable, high‑availability systems.
This article recounts the GitLab production database deletion incident, analyzes why backup mechanisms failed, shares technical and cultural lessons on operational practices, and offers concrete recommendations for building resilient, high‑availability systems to prevent data loss.
GitLab.com suffered a catastrophic database outage on February 1, 2017 when an exhausted operator mistakenly ran a destructive rm command on the wrong server, wiping most production data; the incident’s timeline, root causes, recovery steps, and lessons learned are detailed in this post‑mortem.
This guide walks through simulating a catastrophic Oracle database failure, performing incremental RMAN backups, verifying backup completeness, and executing a full restore and recovery—including spfile, controlfile, datafiles, and archived logs—so you can confidently recover a database after total data loss.
This article explains how to standardize and automate MySQL operations—including multi‑instance deployment, metadata collection, monitoring, backup, and high‑availability using Zookeeper—so that large‑scale database services can be provisioned, managed, and scaled with minimal human intervention.
This comprehensive guide explains MySQL GTID fundamentals, its syntax, how to view and generate GTIDs, configure GTID‑based replication, troubleshoot replication errors, integrate GTID with backup/restore, MHA failover, and ensure crash‑safe slaves while discussing performance trade‑offs.
This article provides a comprehensive, hands‑on guide to MySQL master‑slave replication, covering configuration changes, creating replication users, backing up the master, restoring to slaves, setting up read/write splitting, handling master failures, implementing dual‑master setups, and performing full and incremental backups and restores.
This article explains the importance of data storage, describes single‑node storage engines and data models, outlines transaction and concurrency control, and covers distributed storage principles, CAP and FLP theorems, 2PC and Paxos protocols, as well as redundancy, backup, and failover mechanisms.
This article explains how to design and implement a reliable etcd disaster‑recovery system for a Kubernetes‑based platform, covering backup scheduling, data synchronization across sites, code structure, and the advantages and drawbacks of the approach.
This guide explains why backup security is critical for enterprise databases, introduces Oracle RMAN's three encryption strategies, and provides step‑by‑step commands to configure password‑based encryption, perform backups, handle decryption errors, and finally disable encryption safely.
This guide walks through exporting Oracle PL/SQL user objects and table data with PL/SQL Developer, then restoring them by dropping the existing user, recreating it with necessary privileges, executing the exported SQL script, and importing table data while handling constraints and triggers.
This article explains NetEase Hive RDS's instance migration feature, covering use cases, technical challenges such as consistent backup, business impact, data import speed, incremental sync, and the solutions implemented—including multi‑threaded logical backup with mydumper, load‑aware throttling, parallel import with myloader, and filtered replication—to achieve efficient and safe MySQL migrations.
This guide shows how to restore a MySQL database that was accidentally dropped by combining a nightly full mysqldump backup (with master‑log info) and the subsequent binlog files, extracting only the needed statements and replaying them in order.
This article outlines the lifecycle of a mature MySQL database architecture, covering table design, deployment, performance tuning, scaling strategies such as replication, sharding and partitioning, as well as maintenance tasks like monitoring, backup, and repair, with practical configuration examples.
This guide explains how to back up a MySQL Galera Cluster by leveraging the State Snapshot Transfer (SST) mechanism, detailing the default and custom scripts, required parameters, execution flow, and the key benefits of using SST for point‑in‑time, non‑intrusive backups.
This article explains how to calculate the required capacity and performance for backup storage media, covering assumptions about data volume, retention policies, full and incremental backups, deduplication ratios, RAID configurations, and provides formulas to size storage and IOPS for reliable disaster recovery.
This article examines how backup software ensures enterprise data reliability through media redundancy, server failover, load balancing, and both cold and high‑availability solutions for the management server, highlighting technologies such as GridStor, dual‑array clustering, and deduplication.
The article explains how virtualization backup originated with VMware and now spans major platforms such as VMware, Hyper‑V, and Citrix, detailing their backup interfaces (VADP, VSS, Xen API), backup modes (SAN, Hot‑add, NBD), and practical deployment considerations for enterprise data protection.
This article explains the core features of backup software, focusing on data deduplication and compression techniques, including source‑side, target‑side, and media‑side deduplication, parallel deduplication architectures, replication methods, and hardware snapshot integration, illustrated with SimPana and AnyBackup examples.
The article provides a comprehensive overview of various backup software networking models—including LAN Base, LAN Free, Server Free, NDMP, and the emerging Server‑Less approach—detailing their deployment options, performance impacts, and suitability for different data volumes and infrastructure requirements.
The article explains how traditional centralized backup indexes become performance bottlenecks as data grows, and details Simpana's two‑level distributed indexing architecture—primary and secondary indexes—showing how it enhances backup speed, reduces network load, and simplifies recovery across multi‑site environments.
This article provides a comprehensive overview of backup and disaster‑recovery architectures, detailing backup methods, software components, multi‑domain management, data archiving, and the distinctions between backup and archiving, with examples from Simpana and industry products.
This guide reviews ten beginner-friendly Linux snapshot applications—including TimeShift, Cronopete, Back In Time, Systemback, Snapper, and others—explaining their installation, operation, and how they enable quick system restoration, backup, and migration, while also comparing snapshots to traditional backups.
This guide reviews both proprietary and open‑source cloud storage options for Linux, detailing how each service works, its Linux support, key features, pricing, and limitations to help users choose the right backup solution for their needs.
This article outlines ten practical guidelines for operations engineers—ranging from mandatory rollback testing and cautious handling of destructive commands to robust backup verification, vigilant monitoring, and disciplined handover procedures—to dramatically reduce system outages and improve overall reliability.
This article explains MySQL backup fundamentals, compares cold, snapshot, logical (mysqldump, mydumper) and physical (Xtrabackup) methods, outlines their workflows, pros and cons, and discusses lock‑related performance impacts and Percona's backup‑lock improvements.
This guide explains why data backup is essential, outlines backup types (full, incremental, differential), compares MySQL backup methods (hot, warm, cold), evaluates physical vs logical approaches, reviews common tools like mysqldump, cp, tar, LVM snapshots, and xtrabackup, and offers strategies for choosing the right solution.
This guide provides step‑by‑step instructions for connecting to MySQL, creating and managing users and permissions, displaying, creating and deleting databases and tables, performing backups and restores, and executing various query operations such as selecting, updating, and aggregating data.
This article explains the components, communication mechanisms, full and incremental backup procedures, and restoration steps of Percona XtraBackup (PXB), detailing how the innobackupex script and xtrabackup binary cooperate to perform hot physical backups of MySQL/InnoDB databases.
This article explains why the DBMP platform was created to automate MySQL operations, describes its architecture and key features such as host management, instance groups, backup, slow‑query handling, and scheduled tasks, and outlines future optimization directions and common technical Q&A.
Backup environments generate abundant duplicate data, making deduplication essential; this article examines how purpose‑built backup appliances (PBBA) and leading backup software implement variable‑length, global deduplication, compare scale‑out versus scale‑up architectures, and discuss performance trade‑offs and CPU bottlenecks.
This article examines how deduplication and compression technologies, widely used in backup environments, are adapted for primary storage systems—particularly HDD arrays—by analyzing differences in I/O size, patterns, performance requirements, resource allocation, and implementation approaches of major vendors such as NetApp and EMC.
This article explains data deduplication technology, its definition, various classification schemes based on execution time, block size, granularity, and location, and compares it with data compression, highlighting how both techniques can be combined to maximize storage savings.
This article presents a comprehensive guide to MySQL optimization, covering its strengths and weaknesses, daily DBA tasks, development and operational standards, sharding strategies, backup solutions, performance tuning, replication options, InnoDB configuration, system-level tweaks, and future improvement directions.
This article details Facebook's MySQL backup architecture, covering preparation, logical backup format, storage locations, source selection, full and incremental backup pipelines, verification mechanisms, and future directions such as RBR‑based logical incremental backups.
This article explains Oracle ASM metadata concepts, including ASM file types, allocation units, physical and virtual metadata structures, disk header composition, and practical methods for querying, validating, backing up, and restoring ASM metadata using tools like KFOD, KFED, and X$KFFXP.
To protect MySQL databases from unauthorized access and performance issues, this guide outlines fourteen essential security measures—including restricting remote access, regular backups, disabling default accounts, tightening user privileges, securing configuration files, and enabling logging—providing concrete commands and configuration snippets for robust protection.
This guide outlines practical MySQL hardening techniques—including restricting remote access, regular backups, disabling unsafe features, managing root credentials, removing test databases, and applying security patches—to protect data integrity and prevent unauthorized intrusion.
This article explains XenServer's high‑performance virtualization features, OVF/OVA export capabilities, snapshot‑based backup methods, disaster‑recovery replication, XenCenter management console functions, integration with Microsoft System Center, and the open XenAPI that enables third‑party automation.
This article provides a comprehensive guide to MySQL performance optimization, covering isolation levels, MVCC, schema design, index strategies, query execution, partitioning, replication, scaling, hardware considerations, and backup/recovery techniques for building high‑performance, reliable database systems.
This article presents a comprehensive overview of PostgreSQL, covering its history, architecture, core features, step‑by‑step lab exercises for database creation, CRUD operations, configuration tuning, performance monitoring, backup and recovery, Hot Standby replication, PGPOOL clustering, and a curated Q&A session addressing common DBA challenges.
This comprehensive guide outlines practical PostgreSQL security measures—including hardened authentication, encrypted data transmission, column‑level encryption, strict permission controls, backup strategies, auditing, patch management, and resource monitoring—to help DBAs protect their databases from unauthorized access and attacks.
This article explains why MySQL migration is essential, outlines various migration strategies—including full, partial, and cross‑datacenter moves—and provides detailed, step‑by‑step procedures, best‑practice tips, and precautionary measures to ensure a smooth, reliable transition.
This tutorial walks through three MySQL backup and recovery strategies—using mysqldump with binary logs, LVM snapshots with binary logs, and Percona Xtrabackup—detailing environment setup, command syntax, incremental procedures, and restoration steps to ensure data safety and minimal downtime.
DD Boost integrates tightly with Oracle RMAN to provide a flexible, policy‑driven backup solution that allows DBAs to manage local and disaster‑recovery sites independently, simplifies deployment via a simple plugin, and dramatically improves performance by sending only unique data blocks to Data Domain for deduplication.
The article explains how NetWorker 8.0 introduced Synthetic Full Backup, its inefficiencies with Data Domain, and how NetWorker 8.1, NetBackup, and DD Boost add Virtual Synthetics to accelerate synthetic backups by using metadata pointers instead of full data restoration.
The article explains VMware vSphere as a cloud‑based data‑center virtualization suite, detailing its main components such as ESXi, vCenter, vSphere Client, and Web Access, and covering disaster recovery, backup technologies, storage APIs, and various storage provisioning methods like vSAN, VMFS, RDM, NFS/CIFS and vVol.
This article introduces EMC's DD Boost—a proprietary protocol for Data Domain that improves backup efficiency, lists the backup applications that support it, explains required TCP ports and storage unit setup, and outlines its key features such as distributed segment processing and load balancing.
Redis offers two persistence strategies—RDB snapshots and AOF command logging—each with distinct generation methods, configuration options, and recovery processes, allowing users to balance speed, safety, and data durability based on workload requirements.
This article walks through the full lifecycle of a MySQL database—from initial table design and single‑server deployment to performance tuning, kernel and hardware tweaks, scaling with replication, caching, sharding, partitioning, and essential maintenance tasks such as monitoring, slow‑query logging, backup and repair.
This article presents a comprehensive collection of useful Linux command-line utilities—including dstat, screen, tmux, multitail, rsync, and many others—explaining their purposes, typical use cases, and where to obtain them, helping system administrators and developers improve productivity and monitoring.
This article shares Meituan’s practical strategies for efficient database operations, covering rapid business growth handling, automated DDL workflows, systematic training, capacity planning, backup automation with xtrabackup, and real‑world Q&A on monitoring, replication, and disaster recovery.
This article explains how to convert and restore SQL Server 2000 backup files to SQL Server 2005, detailing direct restore steps, required file extensions, path adjustments, and key differences such as database creation requirements and naming conventions between the two versions.
Learn how to replace traditional backup methods with rsync and inotify for fast, secure, incremental file synchronization, covering rsync fundamentals, command options, server and client configuration, inotify monitoring scripts, and testing procedures to achieve real‑time data replication between Linux servers.
This article outlines four key practices—comprehensive engineering documentation, robust business backup, continuous online monitoring, and regular periodic inspections—that together ensure optimal performance, reliability, and long‑term benefits for data center operations.
This article compiles a comprehensive list of open‑source tools covering backup, cloning, cloud platforms, cloud workflows, distributed file systems, cloud storage, code review, collaboration suites, CMDB, configuration management, continuous integration/deployment, DNS, hosting control panels, IT asset management, and LDAP, providing a valuable resource for IT professionals.
MongoDB 3.0 introduces a pluggable storage engine API with WiredTiger support, expands backup set capacity, adds sharding enhancements, improves security with SCRAM‑SHA‑1 authentication, and upgrades tooling and logging, while retaining MMAPv1 as the default engine.
This guide walks Linux system administrators through rsync's core concepts and a comprehensive set of options—such as -t, -I, -v, -z, -r, -l, -p, -a, and delete flags—explaining their effects, pitfalls, and best‑practice usage for reliable file and directory synchronization.
This guide explains how rsync synchronizes files and directories on Linux, details its most useful options, shows how to configure an rsync daemon with the required configuration files, and outlines the various command syntaxes for local and remote operations.
