This article explains the CAP theorem, its trade‑offs, the BASE model, various consistency levels, and how parameters N, W, and R are used to achieve strong or eventual consistency in distributed database systems.
This guide explains MongoDB 4.2's wildcard indexes, showing how to create single‑field and full‑field wildcard indexes, how they index dynamic schemas, their query behavior for objects and arrays, supported index types, and important limitations such as sparsity and $exists handling.
This article compares the document‑oriented NoSQL databases MongoDB and CouchDB, outlining their architectures, core features, replication and sharding mechanisms, mobile support, and contrasting query approaches with code examples to help choose the appropriate solution for different application scenarios.
This article provides a comprehensive overview of Apache HBase’s architecture, detailing its core components such as RegionServer, HMaster, ZooKeeper, WAL, MemStore, and HFiles, and explains key processes including read/write paths, compaction, region splitting, load balancing, and recovery mechanisms.
In this interview, Apache CouchDB project leaders Adam Kocoloski and Jan Lehnardt discuss the database's unique replication model, strengths and weaknesses, notable real‑world deployments, upcoming 3.0 and 4.0 releases, Kubernetes deployment advice, and guidance for newcomers to Erlang and the CouchDB community.
Tellus, a user‑and‑item task system for Xianyu’s lightweight publishing, guides sellers to complete missing item details or adjust prices by decoupling task creation via MetaQ, storing billions of records in Table Store, and offering configurable, template‑based tasks that have doubled completion rates and accelerated feature rollout.
This article provides a comprehensive overview of database technology, covering relational and NoSQL systems, the historical evolution from navigational to self‑driving databases, current market size and growth, leading vendors, and the accelerating shift toward cloud‑based database services.
This article provides a detailed introduction to databases and DBMS, explains relational and NoSQL models, traces the evolution from navigational to autonomous databases, analyzes global and Chinese market sizes and leading vendors, and discusses the growing shift toward cloud‑based database services.
The article provides a comprehensive analysis of major relational databases—Oracle, DB2, SAP HANA, MySQL, PostgreSQL—and emerging NoSQL solutions, examining their underlying technologies, recent developments, market adoption, and the overall industry landscape shaping the future of data storage.
This comprehensive tutorial covers MongoDB fundamentals, including CRUD operations, display commands, conditional queries, updates, deletions, essential tools like mongod and mongostat, authentication mechanisms, role definitions, configuration settings, and step‑by‑step user and admin creation for secure database management.
The article recounts Salvatore Sanfilippo’s decision to relinquish his role as Redis’s benevolent dictator, outlines the new community‑driven governance model led by Yossi Gottlieb and Oran Agra, and reflects on his personal philosophy about code as artistic self‑expression while highlighting Redis’s continued prominence as a leading NoSQL database.
This article explains the background, competitive landscape, requirements, and architectural design of Tencent CloudBase's cloud database for mini‑programs, detailing its security, ease of use, low‑cost, high‑performance, and flexible solutions, including access control, data safety, elastic scaling, hot migration, and intelligent DBA features.
MongoDB is a versatile NoSQL database that combines relational‑like querying with a flexible BSON document model, offering high performance, easy deployment, rich indexing, replication, and cloud‑scale storage, while supporting multiple programming languages and operating systems.
This article explains the concepts of isolation levels, dirty reads, and phantom reads across various relational and NoSQL databases, describing how each system implements or lacks transaction isolation and the practical impact on data consistency and performance.
This article recounts how Salvatore Sanfilippo, despite a decade of experience in traditional relational databases, abandoned conventional design principles to create Redis, an open‑source in‑memory NoSQL system that now powers major services worldwide.
This article explains the rise of NoSQL databases, the CAP theorem and its CP/AP trade‑offs, critiques of CAP, and the BASE model, illustrating concepts with examples such as HBase and discussing how these principles guide modern distributed data systems.
This article introduces graph databases, explains their underlying graph model, compares them with NoSQL and relational databases, reviews popular implementations such as Neo4j and JanusGraph, and demonstrates querying with the Cypher language, highlighting their advantages for complex relationship queries in modern data‑intensive applications.
This article provides a comprehensive introduction to HBase, covering its origins, key characteristics, architecture components, installation steps, basic shell commands for table management, data structures, read/write processes, and high‑availability configuration within the Hadoop ecosystem.
This article introduces Redis as an open‑source in‑memory data‑structure store, explains its role as a NoSQL database, covers fundamental data types, common commands, expiration handling, and advanced features like pipelines and transactions, providing a comprehensive guide for developers.
This article explains the principles, evolution, modern structures, compaction strategies, optimization techniques such as Bloom filters and partitioning, and concurrency and recovery mechanisms of Log-Structured Merge (LSM) trees, which are widely used in contemporary NoSQL storage systems.
This comprehensive guide introduces NoSQL concepts, classifies non‑relational databases, explains why MongoDB is suited for loosely structured data, walks through Windows and Linux installations, demonstrates using Robo 3T, and covers all CRUD operations, queries, updates, deletions, and data de‑duplication with practical code examples.
This tutorial explains how to install PyMongo, connect to local or remote MongoDB instances, choose databases and collections, and perform all common CRUD operations—including inserts, queries, updates, deletions, and special cases—using Python code examples and practical tips.
This comprehensive guide introduces MongoDB, explains NoSQL classifications, walks through Windows and Linux installations, demonstrates using the Robo 3T GUI, and covers essential CRUD operations, queries, indexing, sorting, counting, and data deduplication with clear code examples and screenshots.
This article explains the core mechanisms of HBase—Flush and Compaction—detailing why they are needed, the conditions that trigger Flush, the types and triggers of Compaction, and provides practical recommendations for tuning the most important configuration parameters to improve write and read performance.
This article provides a comprehensive overview of HBase, covering its LSM‑Tree based storage engine, key‑value data model, column‑family storage design, indexing mechanisms, major advantages and drawbacks, and typical scenarios where HBase excels for massive, high‑throughput data workloads.
The article examines the 2019 DB-Engines ranking that crowned MySQL as the DBMS of the Year, discusses its historical development, compares it with Oracle and SQL Server, analyzes the rise of NoSQL systems, and explores the implications of hybrid features in modern relational databases.
The 2019 DB-Engines ranking crowned MySQL as the most popular DBMS, with Oracle and Microsoft SQL Server following, and discusses how relational databases dominate while NoSQL systems remain vital, highlighting evolving features and the implications for future database technology choices.
This article explains how MySQL X API (available since MySQL 5.7) can replace NoSQL databases by enabling the X protocol, showing configuration steps, equivalent insert examples, and detailed CRUD, indexing, and transaction operations with code snippets.
This article summarizes a Cassandra meetup presentation that traces the database's origins from BigTable and Dynamo, outlines its key milestones, explains its peer‑to‑peer and LSM architecture, highlights current features, real‑world deployments, performance advantages, and previews upcoming 4.0 releases and community projects.
The 2019 dbaplus Newsletter compiles a detailed overview of major RDBMS, NoSQL, NewSQL, big‑data, Chinese and cloud database releases, highlighting key features, performance improvements, security enhancements, and future road‑maps for each product.
In his CNBPS 2019 keynote, MongoDB architect Song Zhiqi discusses how the shift to cloud‑native architectures has amplified data volume and variety, outlines the key challenges such as rapid rollout, downtime, and unstructured data, and explains how MongoDB’s flexible, high‑availability document model addresses these issues while supporting modern micro‑service and Kubernetes ecosystems.
Youzan’s evolution of HBase bulk‑load—from manual MapReduce jobs to Hive‑SQL and finally Spark—demonstrates how generating HFiles on HDFS, partitioning by region, sorting keys, and handling serialization issues enables billions of records to be loaded efficiently without disrupting production clusters.
Lindorm, an Alibaba‑derived distributed NoSQL database built on HBase, delivers multi‑model hybrid storage, five‑fold throughput gains, sub‑millisecond latency, advanced indexing, cloud‑native elasticity, strong/adjustable consistency, and comprehensive security and multi‑tenant features for massive data workloads.
ScyllaDB, a high‑performance C++ implementation of Apache Cassandra, introduces row‑level repair to replace the traditional partition‑level repair, reducing data transfer and I/O by operating on individual rows; the presentation details its architecture, multi‑stage process, experimental results, and the resulting six‑fold speedup.
This article outlines the three generations of databases—SQL, NoSQL, and NewSQL—explaining the limitations of traditional relational systems, the scalability and consistency trade‑offs of NoSQL, and how NewSQL combines distributed architecture with ACID guarantees, while also listing major NewSQL projects.
This article explains HBase's data model and key components, details column descriptor options such as BloomFilter, Compression, Versions, TTL, and MinVersion, and provides practical design guidelines for columns, rowkeys, high vs. wide tables, region pre‑splitting, and hotspot mitigation to achieve optimal performance.
The article introduces JDNoSQL, a distributed column‑oriented key‑value store built on HDFS, outlines its core features, describes various business scenarios including real‑time ad computation, details the system architecture with Kafka and Flink, and presents table designs for ad impression and click statistics.
This article explains HBase’s data model and provides comprehensive table‑design strategies—including column‑descriptor options, row‑key best practices, high‑vs‑wide table trade‑offs, region splitting and pre‑splitting techniques—to help achieve optimal performance and scalability in large‑scale NoSQL workloads.
This article provides a comprehensive overview of Apache Cassandra, covering its origins at Facebook, key architectural features such as distributed design, elastic scalability, tunable consistency, and high availability, as well as typical deployment scenarios and notable companies that use it.
This article examines the most popular open‑source and commercial database systems in 2019, presents DB‑Engines rankings, explores single versus hybrid strategies, highlights popular SQL‑NoSQL combos, and identifies the most time‑consuming DBA tasks and key performance metrics.
This article explains the differences between structured, semi‑structured and unstructured data, walks through the evolution stages of relational database architectures, evaluates their advantages and drawbacks, and then compares major NoSQL families—KV, search, column‑oriented and document stores—to help engineers decide the right storage engine for their workloads.
The article traces how each mobile generation—from 1G’s early relational databases to 2G’s open‑source RDBMS, 3G’s scalable NoSQL, 4G’s NewSQL hybrids, and the emerging 5G era demanding ultra‑low latency, cloud‑native, AI‑driven real‑time analytics—shapes database architecture and future trends.
This article provides a comprehensive, illustrated explanation of Apache HBase's architecture, covering its master‑slave components, region management, Zookeeper coordination, data flow for reads and writes, storage structures, compaction processes, fault recovery, and the system's strengths and limitations within the Hadoop ecosystem.
This article explores Redis persistence mechanisms, detailing how RDB snapshots and AOF append‑only logs work, how to configure them, their advantages and drawbacks, and guidance on choosing the right strategy for reliable data storage.
This article explores the resurgence of SQL, tracing its historical roots, the rise and limitations of NoSQL, and how modern cloud and NewSQL solutions are re‑establishing SQL as the universal interface for data storage, processing, and analysis.
The article outlines eight practical techniques—including caching, page staticization, database optimization, hot‑data separation, operation merging, read‑write splitting, distributed databases, and the use of NoSQL and Hadoop—to efficiently store and serve massive data volumes in large‑scale internet services.
This article provides a comprehensive overview of HBase, covering its distributed column‑oriented architecture, data model components, storage mechanisms, read/write processes, WAL lifecycle, MemStore flushing, region splitting and merging, and failure recovery within the Hadoop ecosystem.
This article explains what NoSQL databases are, introduces the CAP theorem that underlies their design trade‑offs, outlines typical application scenarios, discusses their limitations, classifies the main NoSQL families, and reviews four widely used systems—Redis, HBase, Cassandra, and MongoDB.
This article explains the ACID principles of relational databases versus the CAP principles of NoSQL systems, illustrates why distributed systems can only satisfy two of consistency, availability, and partition tolerance, and discusses how Eureka and Zookeeper embody AP and CP choices, especially during high‑traffic events like Double‑11.
This tutorial introduces Elasticsearch, explains its architecture and use cases, walks through installation, index creation, mapping, CRUD operations, and demonstrates how to integrate and query Elasticsearch from Python using both the REST API and the official client library.
Fusion, Didi’s home‑grown C++ NoSQL database built on RocksDB, powers over 400 services and 1.5 PB of data, then evolved into the NewSQL layer dise with schema, secondary indexes, transactions and MySQL‑compatible binlog, and now guides a next‑gen distributed database project targeting true elastic scaling, distributed transactions and full SQL compatibility.
This article details Didi's evolution from a self‑built NoSQL system called Fusion to a NewSQL solution and outlines the challenges, architectural highlights, data migration mechanisms, and future distributed database design, providing concrete metrics, diagrams, and practical lessons learned.
This article explains the fundamentals of NoSQL databases, the CAP theorem trade‑offs, and why HBase—a column‑oriented, distributed NoSQL system—offers strong consistency, automatic sharding, high availability, and seamless Hadoop integration, while also outlining its ideal scenarios and limitations.
This article introduces HBase, a distributed column‑oriented NoSQL database built on Hadoop, explains its architecture, data model, key concepts such as rowkeys, column families, timestamps, regions, and ZooKeeper, outlines its main features and typical use cases, and provides common HBase shell commands with examples.
This article introduces HBase, its origins from Google Bigtable, core concepts such as RowKey, Column Family, and Versioning, and explains its logical and physical table views, storage mechanisms, and cluster architecture within the Hadoop ecosystem.
YouZan’s order data synchronization moves changes from MySQL through Canal‑parsed binlogs into a message queue, then uses sequential SeqNo‑based optimistic locking and HBase’s column‑version timestamps to guarantee ordering for both single‑ and multi‑table updates, while a Logstash‑style configurable pipeline feeds ES for search and HBase for detail queries, eliminating ordered‑queue bottlenecks and ensuring high‑throughput consistency.
This article examines the limitations of traditional relational databases and explains how NoSQL solutions—key‑value stores, document databases, columnar databases, and full‑text search engines—address issues like schema rigidity, high I/O, and weak search, helping you choose the right data store.
Fusion is Didi’s self‑developed distributed NoSQL database, fully compatible with the Redis protocol, that combines Redis‑level low latency, MySQL‑level durability, ACID transactions, multi‑replica high availability, FastLoad bulk import, NewSQL secondary indexes, and cross‑datacenter active‑active replication to serve petabyte‑scale ride‑hailing data.
This article explains the architecture and mechanisms of Alibaba Cloud's Table Store load‑balancing system, detailing how it collects metrics, detects user‑access and machine hotspots, and automatically applies actions such as partition moves, splits, merges, and isolation to maintain high availability and performance.
This article explains HBase as a high‑performance, column‑oriented distributed storage system, outlines its advantages and limitations, presents real‑world scenarios such as seller operation logs and message logs, and details its data structures, architecture components, and design considerations for big‑data applications.
The January 2019 DB-Engines newsletter compiles the newest releases, feature highlights, and performance improvements across RDBMS, NoSQL, NewSQL, time‑series, big‑data, domestic, and cloud database families, while also explaining the ranking methodology and providing download links for the full issue.
This article introduces HBase fundamentals, explores effective RowKey and secondary index design principles, discusses demand analysis, presents techniques such as reversing, salting, hashing, and reviews real-world case studies for OpenTSDB, JanusGraph, and GeoMesa, offering practical guidance for scalable NoSQL data modeling.
This article provides a comprehensive overview of Apache HBase, covering its core architecture, key features such as automatic sharding, LSM‑Tree storage, separation of storage and compute, the ecosystem, real‑world use cases, recent 2.0 enhancements, upgrade guidance, future plans, and community recruitment information.
Chubao Database (CBDB) is a second-generation elastic, multi-model database service that supports KV, document, graph, and SQL models via multiple protocols, simplifying stacks, reducing costs, and providing horizontal scalability, high availability, strong consistency, and distributed transactions.
In the era of big data, DBAs face higher demands and NoSQL technologies have risen, so this article shares GeTui's KV storage architecture evolution, operational challenges, NoSQL selection criteria, Codis+ enhancements, Aerospike evaluation, monitoring practices, and best‑practice recommendations for scalable database operations.
This article provides a concise overview of three data storage solutions—Hive, MongoDB, and Redis—detailing their core concepts, operational principles, typical use cases, and key characteristics to help developers choose the appropriate technology for various workloads.
This article analyzes the shortcomings of traditional relational databases in big‑data scenarios and introduces five major NoSQL categories—columnar, key‑value, document, full‑text search, and graph databases—detailing their principles, advantages, disadvantages, common implementations, and appropriate use cases to guide storage technology selection.
The article explains how Spring Data provides a unified, Spring‑compatible data‑access layer for relational and NoSQL stores, illustrates its features and typical use cases, and walks through a practical Spring Data Elasticsearch integration—including configuration, entity and repository definitions—and details the dynamic proxy loading mechanism behind Spring Data repositories.
This article explains what graph databases are, traces their evolution from early navigational models to modern distributed systems, highlights their core concepts and advantages over relational databases, showcases typical application scenarios, and provides a comparative overview of popular open‑source graph database engines to guide technology selection.
This tutorial walks you through installing Elasticsearch, creating indices, inserting and updating documents, performing searches via REST API, and integrating Elasticsearch into Python applications using both raw HTTP requests and the official Python client, illustrated with practical examples and screenshots.
The article warns developers about the dangers of blindly following flashy technologies—such as over‑abstracted patterns, NoSQL hype, endless scalability promises, micro‑services mania, and agile buzzwords—by highlighting real‑world pitfalls and urging thoughtful, purpose‑driven engineering decisions.
This article explains the definition of big data, its characteristic 3Vs, common data sources, supporting IT infrastructure, key technologies such as Hadoop and Spark, specialized databases, required skills, and several practical business use cases.
MongoDB 4.0 introduces true ACID‑compliant multi‑document transactions, bridging the gap between relational database consistency and NoSQL flexibility, while preserving high performance, scalability, and ease of development for a wide range of application scenarios.
This article introduces MongoDB, an open-source document-oriented database, outlines its key features such as indexing, sharding, and MapReduce, and provides step-by-step instructions for installing and running MongoDB on a system using Homebrew, along with basic shell commands.
This article provides a comprehensive overview of HBase's architecture, detailing the roles of RegionServers, HMaster, ZooKeeper, Regions, the META table, write and read paths, compaction processes, region splitting, load balancing, HDFS replication, crash recovery, and the system's advantages and challenges.
MySQL 8.0 GA (8.0.11) brings up to twice the performance of 5.7, adds NoSQL document storage, window functions, hidden and descending indexes, CTEs, enhanced JSON handling, improved InnoDB reliability, built‑in high availability, and stronger security, while requiring in‑place upgrades and backups.
This article explains the architecture, data model, and multi‑tenant load‑balancing strategies of Alibaba Cloud Table Store, detailing the challenges of distributed NoSQL systems and presenting practical solutions for resource quantification, fairness, trigger timing, and SLA‑driven automation.
In this interview, Redis China User Group chair Zhang Donghong shares the database’s key features, version history, data types, high‑availability options, clustering mechanics, automation challenges, future trends, and practical advice for beginners, illustrating how Redis powers massive online services.
The March 2018 DBAplus Newsletter compiles the latest releases across RDBMS, NoSQL, NewSQL, time‑series and big‑data ecosystems, highlighting new features, performance improvements, compatibility updates and key technical links for Oracle, MySQL, MariaDB, SQL Server, DB2, PostgreSQL, TiDB, CockroachDB, InfluxDB, Hadoop and several Chinese‑made databases.
The article explains the limitations of relational databases for large‑scale, highly connected data, introduces NoSQL and graph database models, demonstrates how graph queries efficiently retrieve multi‑degree social connections, and showcases Neo4j’s performance advantages over traditional RDBMS.
Meituan built a scalable scenario‑query platform that unifies traffic, activity and investment data by layering RPC services, a Storm‑driven pre‑computation tree stored in Redis/Tair, and a middle‑platform API with circuit‑breaker logic, cutting response times from seconds to under one second while dramatically reducing code coupling and simplifying future feature development.
This article explains the concept of NoSQL, contrasts it with traditional SQL databases, and walks you through building a minimal key‑value NoSQL server in pure Python, covering schema basics, indexing, message parsing, command handling, and practical code examples.
This article explains the evolution of instant messaging systems, introduces the Timeline logical model for message synchronization and storage, compares traditional and modern architectures, and details how Alibaba Cloud TableStore can be used to build a high‑performance, multi‑device IM backend supporting millions of TPS and millisecond latency.
This article evaluates MongoDB and MySQL for storing and querying large‑scale precious‑metal market data, detailing hardware setup, version configurations, schema designs, and extensive performance benchmarks across million‑ to billion‑record datasets, and concludes with analysis of memory architectures, data models, and suitable application scenarios.
This article explains HBase's high‑reliability, scalability, and performance characteristics, outlines its advantages and drawbacks, presents real‑world scenarios such as seller operation logs and Jingmai message logs, and details its data model, architecture components, operational principles, and key design considerations for effective use.
The October 2017 DBAplus Newsletter summarizes the newest releases across RDBMS, NoSQL, NewSQL, time‑series, big‑data and domestic databases, highlighting key features, performance improvements, and ecosystem updates while providing links to official documentation and source repositories.
Since its inception, Facebook has relied on MySQL to handle data from over two billion users, but recent shifts toward NoSQL have led to the development of Apollo—a layered storage system inspired by Paxos, Raft, RocksDB, and custom APIs, aiming to improve scalability, latency, and fault tolerance.
The article compiles Meituan‑Dianping engineers' Q&A covering SQL book suggestions, relational versus NoSQL engine choices, performance tuning techniques, time‑series database uses, sharding versus partitioning strategies, query handling in distributed systems, proxy limitations, and practical advice on replication and pre‑database setups.
This article explains the scenarios where HBase is appropriate, introduces core HTable concepts such as row keys, column families, columns, timestamps and values, and outlines design principles for schema and versioning to efficiently handle semi‑structured, sparse, multi‑version and massive data sets.
The article lists eight common frustrations with MySQL—from deep‑rooted bugs and rigid relational schemas to confusing storage engines and missing native JSON support—explaining why these issues still trouble developers despite MySQL’s popularity.
This article explains how Couchbase, a distributed NoSQL database, enables personalization, real‑time big‑data processing, and flexible content management for large enterprises, highlighting key requirements, solutions, and real‑world case studies from AOL, PayPal, and a Fortune‑500 media company.
This article explains transaction isolation levels, dirty reads, and phantom reads, compares how major databases such as SQL Server, PostgreSQL, MySQL, Oracle, DB2, MongoDB, CouchDB, Couchbase, and Cassandra implement these concepts, and highlights the performance‑security trade‑offs of each isolation level.
This article walks through the concepts behind NoSQL databases, contrasts them with traditional SQL relational models, and provides a step‑by‑step Python implementation of a minimalist key‑value store, complete with command parsing, TCP/IP messaging, and code examples.
This article explains what NoSQL means, compares it with traditional SQL databases, and walks through creating a lightweight Python key‑value store with TCP/IP commands, illustrating schema design, indexing, query examples, and the full source code for a toy NoSQL system.
Facing ever‑growing complexity, Java developers can streamline their projects by mastering a curated list of essential data storage and processing tools—including MongoDB, Elasticsearch, Cassandra, Redis, Hazelcast, EHCache, Hadoop, Solr, Spark, and Memcached—each offering distinct strengths for modern big‑data applications.
The April 2017 DBAplus Newsletter compiles the latest database releases, DB‑Engines ranking data, feature updates for Oracle, MySQL, MariaDB, SQL Server, PostgreSQL, Hadoop, and emerging domestic systems, while summarizing key new‑SQL, NoSQL, and big‑data developments for database professionals.
This article chronicles the evolution of a LNMP‑based website from a single‑machine setup to a multi‑server architecture handling millions of daily visits, detailing each scaling stage—including adding a database server, introducing memcached, implementing MySQL read‑write separation, load balancing, and NoSQL integration.
This article chronicles the step‑by‑step evolution of a LNMP‑based website, detailing how increasing traffic drove architectural changes such as separating web and database servers, adding memcached, implementing MySQL master‑slave replication, load balancing, NFS sharing, and finally integrating NoSQL caching to handle millions of daily visits.
This article explains the architecture, real‑time computation framework, and storage solutions of Tencent Analytics, detailing how massive TB‑level web‑traffic data are collected via JavaScript, processed in memory‑centric streaming components, and stored using Redis and LevelDB to achieve second‑level updates.
The DBAplus Newsletter reviews recent DB‑Engines ranking trends, highlights major releases across RDBMS, NoSQL, NewSQL and big‑data ecosystems, analyzes shifting market dynamics, and lists upcoming community events and resources for database professionals.
