Tag

WAL

0 views collected around this technical thread.

Tencent Cloud Developer
Tencent Cloud Developer
Dec 4, 2024 · Databases

Building a Distributed Database Storage Engine: From LSM Tree to Data Sharding

This article walks through building a database storage engine from a simple shell script to a full distributed key‑value system, covering in‑memory indexing, SSTable creation, LSM‑Tree architecture with compaction, replication strategies, and sharding techniques for scaling across multiple machines.

B+ TreeData ShardingDistributed Database
0 likes · 38 min read
Building a Distributed Database Storage Engine: From LSM Tree to Data Sharding
Sanyou's Java Diary
Sanyou's Java Diary
Jul 11, 2024 · Databases

Master MySQL Redo Log & Binlog: 15 Essential Interview Questions Explained

This article presents 15 classic MySQL log interview questions and provides detailed explanations of redo log, WAL, binlog, undo log, two‑phase commit, log flushing mechanisms, and recovery strategies, helping readers deepen their database knowledge and ace technical interviews.

Database RecoveryMySQLWAL
0 likes · 18 min read
Master MySQL Redo Log & Binlog: 15 Essential Interview Questions Explained
政采云技术
政采云技术
Dec 27, 2023 · Databases

Understanding MySQL Binary Log (binlog): Architecture, Usage, and Implementation

This article explains MySQL's binary log (binlog), a binary format file that records SQL statements for database updates, its role in master-slave replication, crash recovery, and detailed implementation mechanisms including cache management and event writing processes.

Database InternalsMaster‑SlaveMySQL
0 likes · 8 min read
Understanding MySQL Binary Log (binlog): Architecture, Usage, and Implementation
Soul Technical Team
Soul Technical Team
Oct 9, 2023 · Databases

Understanding SQLite Log Modes and Fixing Duplicate Message ID Issues in Chat Applications

This article explains SQLite's Rollback and WAL logging modes, compares their performance and concurrency characteristics, investigates a real‑world problem where duplicate IM message IDs appear after app upgrades, and presents a step‑by‑step solution using UNIQUE constraints and index checks to prevent repeated inserts.

Chat ApplicationRollbackSQLite
0 likes · 26 min read
Understanding SQLite Log Modes and Fixing Duplicate Message ID Issues in Chat Applications
Qunar Tech Salon
Qunar Tech Salon
Nov 5, 2020 · Databases

Managing Excessive WAL Growth in PostgreSQL 11: Diagnosis and Resolution

This article explains why a low‑traffic PostgreSQL 11 database can accumulate massive WAL files, analyzes relevant configuration parameters and replication slots, demonstrates diagnostic SQL commands, and provides step‑by‑step actions—including adjusting archive_timeout, handling replication slots, and forcing a checkpoint—to reclaim disk space.

Database AdministrationPerformance TuningPostgreSQL
0 likes · 8 min read
Managing Excessive WAL Growth in PostgreSQL 11: Diagnosis and Resolution
vivo Internet Technology
vivo Internet Technology
May 20, 2020 · Databases

Understanding MySQL Crash‑Safe Mechanism: WAL, Redo/Undo/Binlog, Two‑Phase and Group Commit, and Recovery Process

MySQL achieves crash‑safe durability by employing a write‑ahead log architecture that records changes in redo, undo, and binary logs, coordinates them through two‑phase and group commit to maintain order, and uses a structured recovery process to replay or roll back transactions after any failure.

Crash SafetyMySQLTwo-Phase Commit
0 likes · 17 min read
Understanding MySQL Crash‑Safe Mechanism: WAL, Redo/Undo/Binlog, Two‑Phase and Group Commit, and Recovery Process
System Architect Go
System Architect Go
Oct 28, 2019 · Databases

InfluxDB Storage Engine Architecture and Hardware Recommendations

This article explains InfluxDB's storage engine workflow—including WAL, Cache, TSM files, compression components, and file management—then provides hardware sizing guidance based on write/query load, series cardinality, and recommends SSD storage with sample configuration settings.

HardwareInfluxDBStorage Engine
0 likes · 5 min read
InfluxDB Storage Engine Architecture and Hardware Recommendations
JD Retail Technology
JD Retail Technology
Oct 25, 2019 · Backend Development

Design and Optimization Strategies for High‑Concurrency Instant Messaging Processing

This article explains how to handle high‑concurrency instant‑messaging scenarios by designing message deduplication, optimizing SQLite write performance with batch inserts and WAL mode, improving query speed with indexes and caching, and reducing UI refresh overhead through delayed and scroll‑aware updates.

Instant MessagingMessage DeduplicationSQLite
0 likes · 19 min read
Design and Optimization Strategies for High‑Concurrency Instant Messaging Processing
JD Tech Talk
JD Tech Talk
Oct 24, 2019 · Databases

JDTX Distributed Transaction Solution: Design Principles, Features, and Implementation Challenges

This article introduces JDTX, a high‑performance, ACID‑compliant distributed transaction middleware, explains its architecture based on WAL and MVCC, compares rigid two‑phase commit and flexible BASE‑based approaches, and discusses the technical difficulties and future roadmap for integrating JDTX with Apache ShardingSphere and cloud‑native platforms.

ACIDDatabase MiddlewareJDTX
0 likes · 15 min read
JDTX Distributed Transaction Solution: Design Principles, Features, and Implementation Challenges
Aikesheng Open Source Community
Aikesheng Open Source Community
Apr 4, 2019 · Databases

Understanding MySQL Binlog Group Commit: Flush, Sync, and Commit Phases

This article explains MySQL's binlog group commit mechanism, detailing the three stages—Flush, Sync, and Commit—how they interact with redo logs and crash‑safe parameters, and analyzes a known bug in the Sync stage that was fixed in later MySQL versions.

MySQLWALbinlog
0 likes · 7 min read
Understanding MySQL Binlog Group Commit: Flush, Sync, and Commit Phases
Tencent Cloud Developer
Tencent Cloud Developer
Dec 23, 2016 · Databases

Analysis of HBase Write-Ahead Log (WAL) Mechanism and Source Code Call Chain

The article explains HBase’s write‑ahead‑log architecture, detailing how client put/delete requests travel through RPC to the RegionServer, are processed by MultiRowMutationService, written to the WAL via FSHLog.append and sync, and finally stored in MemStore, while describing durability options and the underlying source‑code call chain.

Big DataDistributed StorageHBase
0 likes · 10 min read
Analysis of HBase Write-Ahead Log (WAL) Mechanism and Source Code Call Chain