This article presents a detailed case study of moving a 2‑petabyte smart‑product data workload from Elasticsearch to MongoDB, covering business background, source cluster architecture, MongoDB design and resource planning, step‑by‑step performance optimizations, latency and cost comparisons, and guidance on when each database is appropriate.
The article reproduces a MongoDB issue where queries using a hashed shard key return no results and a compound unique index silently accepts duplicate documents, explains that the failIndexKeyTooLong parameter allows oversized index entries to be stored without indexing, and shows how to reproduce and fix the problem.
This article presents a complete food‑delivery system with mobile, admin, and API modules, detailing its Spring Boot and Vue.js technology stack, module structure, database setup, quick‑start commands, and how to run both the management console and mobile client for learning purposes.
This article explains how Kubernetes Headless Services and DNS can be used to discover and connect to the IP addresses of all Pods behind a Service, with a step‑by‑step example using a MongoDB replica set.
This comprehensive tutorial walks you through installing MongoDB on Windows, configuring data and log directories, setting environment variables, creating and managing databases, collections, indexes, aggregation pipelines, backup and restore procedures, monitoring tools, advanced query operators, user management, and using a visual tool like Navicat for MongoDB.
This article explains MongoDB's document-oriented data model, shows how to create an admin user, configure the mongod service on Linux, and provides detailed command‑line examples for backing up and restoring databases and collections using mongodump, mongorestore, mongoexport, and mongoimport.
This article shares an interview experience that compares MongoDB and MySQL, explains the advantages and disadvantages of document‑oriented and relational databases, introduces other NoSQL solutions such as Elasticsearch, and offers guidance on choosing the right storage technology based on workload characteristics.
This comprehensive guide explains MongoDB cluster components, common use cases, monitoring commands, basic operational tasks, data migration procedures, troubleshooting of production issues, and optimization recommendations to achieve high performance and scalability.
This article explains how Vivo designed a company‑wide comment middle‑platform, chose MySQL and MongoDB, deep‑dived into MongoDB cluster architecture, shard key strategies, and practical solutions for scaling, migration, and high availability in a high‑traffic environment.
This article walks through building a Python web crawler that extracts forum post comments into MongoDB, covering project goals, environment setup, site structure analysis, Scrapy and Selenium integration, data storage design, handling anti‑scraping measures, and performance optimization with multithreading.
This tutorial walks you through upgrading Spring Boot, introduces MongoDB basics, and provides a hands‑by‑step guide to adding the spring‑boot‑starter‑data‑mongodb dependency, defining entity and repository classes, writing unit tests, and configuring connection properties for robust backend data management.
This article details Vivo's journey in building a company‑wide comment platform, explaining why MongoDB was chosen over MySQL, how its sharded cluster is structured, the challenges of shard‑key selection, and the practical steps taken to scale and maintain the system.
This guide walks through migrating documents from a MongoDB 3.4.1 cluster to an Apache CouchDB 2.2 cluster using a Python script that leverages pymongo and CouchDB’s REST API, covering environment setup, migration steps, code execution, and verification of transferred data.
This article details OPPO's journey of adopting MongoDB at massive scale, addressing common misconceptions, designing multi‑data‑center active‑active architectures, optimizing thread models and migration processes, and applying performance‑boosting techniques that yielded multi‑fold improvements for trillion‑row clusters.
This article systematically refutes ten widespread misconceptions about MongoDB—covering scalability, versioning, data format, transactions, relationships, sharding, security, data loss, and suitability—while explaining its architecture, BSON storage, and best‑practice usage with illustrative code examples.
This article provides a detailed Linux tutorial for installing MongoDB, disabling the firewall, extracting the package, setting environment paths, creating data and log directories, editing the configuration file, and launching the database both in foreground and as a background service.
This guide reviews thirteen popular MongoDB graphical tools—covering open‑source and commercial options, their key features, platform support, and download links—to help developers and DBAs choose the most suitable visual interface for managing MongoDB databases.
This article explains how Debezium's MongoDB Source Connector captures change events from replica sets or sharded clusters, streams them to Kafka topics, and provides detailed configuration, deployment, monitoring, and troubleshooting steps for building reliable change‑data‑capture pipelines.
This article explains how Spark can be combined with MongoDB for large‑scale data processing, covering Spark fundamentals, comparisons with HDFS, practical integration patterns, performance benefits, real‑world case studies, and detailed code examples for deployment and analytics.
The article describes the challenges of maintaining test cases amid organizational changes and introduces a functional test case platform that centralizes case storage, supports version‑driven updates, enables reuse of business modules and base components, and outlines its backend MongoDB design, frontend mind‑map UI, and future roadmap.
This guide explains MongoDB replica set fundamentals, walks through local deployment of a primary‑secondary‑secondary cluster, demonstrates automatic failover, and details write concern and read preference options—including member attributes, connection string parameters, and shell commands—for reliable high‑availability data handling.
This article explains how to scrape detailed job description and address information from online job portals, use Python libraries such as requests, BeautifulSoup4, and pymongo for crawling, and then clean and normalize the collected data including publish dates, salaries, and work‑experience levels before storing it in MongoDB.
This comprehensive guide explains what NoSQL is, contrasts non‑relational and relational databases, outlines the main representatives of each, dives deep into MongoDB architecture, features, use‑cases and limitations, and also covers MySQL fundamentals, replication, backup, and common monitoring tools like Prometheus and Zabbix.
This guide walks you through installing the Go MongoDB driver, establishing connections, and performing full CRUD operations—including inserting single and multiple documents, querying, updating, and deleting records—while also showing how to retrieve server status and explaining BSON handling in Go.
MongoDB’s flexible, schema‑less design offers performance benefits but can become a maintenance nightmare as projects grow, so the article explains why introducing external schema protocols like Google’s Protobuf or Facebook’s Thrift provides structure, reduces bugs, and balances flexibility with robustness.
A high‑traffic Java service using MongoDB experienced intermittent latency spikes and a full‑scale outage caused by excessive connection churn, kernel‑level random‑number generation bottlenecks, and mis‑configured client timeouts, which were diagnosed through log analysis, packet captures, and performance testing, leading to concrete mitigation steps.
This guide explains MongoDB 4.2's wildcard indexes, showing how to create single‑field and full‑field wildcard indexes, how they index dynamic schemas, their query behavior for objects and arrays, supported index types, and important limitations such as sparsity and $exists handling.
This article compares the document‑oriented NoSQL databases MongoDB and CouchDB, outlining their architectures, core features, replication and sharding mechanisms, mobile support, and contrasting query approaches with code examples to help choose the appropriate solution for different application scenarios.
This comprehensive tutorial covers MongoDB fundamentals, including CRUD operations, display commands, conditional queries, updates, deletions, essential tools like mongod and mongostat, authentication mechanisms, role definitions, configuration settings, and step‑by‑step user and admin creation for secure database management.
This step‑by‑step tutorial shows how to set up a highly available MongoDB cluster with sharding and replica sets on Ubuntu 18.04, covering key concepts, environment preparation, configuration of config servers, shard replica sets, the mongos router, enabling sharding, testing data distribution, and final deployment tips.
This article explains how to upgrade the think-mongo module for ThinkJS to work with MongoDB 4.x, detailing API changes, new CRUD method mappings, transaction support, and provides code examples for adapting existing projects to the latest MongoDB features.
This guide explains how to set up a PHP‑based web platform that collects MongoDB slow‑query logs via remote profiling, stores them in MySQL, and visualizes the data, including installation of required PHP extensions, database preparation, configuration, cron scheduling, and enabling profiling on MongoDB.
This guide explains MongoDB permission levels, clarifies common misconceptions, and provides step‑by‑step commands to create ordinary, administrative, authorization, and super‑admin users, enable authentication, and verify read/write access across multiple databases.
This article explains why a fast‑growing e‑commerce platform chose MongoDB, covering its high‑availability replica‑set architecture, Raft‑based election algorithm, replica‑set size limits, write‑concern trade‑offs, sharding components and load‑balancing, as well as the flexible document schema with practical code examples.
MongoDB is a versatile NoSQL database that combines relational‑like querying with a flexible BSON document model, offering high performance, easy deployment, rich indexing, replication, and cloud‑scale storage, while supporting multiple programming languages and operating systems.
After upgrading a three‑shard MongoDB cluster from version 3.2 to 4.0, CPU usage jumped from 10 % to 40 % due to more frequent moveChunk operations and the resulting delete workload, as the balancer’s imbalance thresholds changed between versions.
This article explains various MongoDB pagination strategies—including skip/limit, range queries, and sorting—covers performance monitoring with profiling, details index creation and design principles, and describes how to interpret explain plans for efficient query optimization.
This article introduces thirteen popular MongoDB graphical tools—including Robo 3T, Navicat, Compass, NoSQLBooster, ClusterControl, NoSQLClient, Studio 3T, Mongo Management Studio, Aqua Data Studio, phpMoAdmin, Mongotron, Mongolime, and mongo‑express—detailing their key features, platform support, and download links to help users choose the best visual interface for database administration.
This article explains how loop‑based database queries degrade performance and demonstrates three concrete optimizations—using IN clauses in MySQL, aggregation pipelines in MongoDB, and Redis pipelines—to replace repetitive queries with bulk operations, improving speed and maintainability.
This article introduces the community‑maintained SpaceX REST API that aggregates all launch, vehicle, and payload data, explains how to query it using tools like Postman or Python, and provides deployment options via Docker or local npm setup for developers.
This article introduces the community‑maintained r/SpaceX REST API that aggregates every SpaceX rocket datum, explains how to query it via JSON in multiple languages, provides a Python example, and details Docker, local, and Postman deployment options for developers.
This guide walks you through downloading DataGrip, configuring its appearance, creating MySQL and MongoDB data sources, managing tables, applying powerful SQL editing shortcuts, and leveraging export and execution‑plan features to write higher‑quality database code.
This guide explains how to install the Elasticsearch Python client, build a wrapper class for index management and CRUD operations, import data from MongoDB, use a Celery‑based crawler to harvest Baidu Baike content, and expose search functionality through Flask or other Python web frameworks.
The article presents Ctrip's platform-driven API automated testing solution, detailing the challenges of traditional script-based testing, the proposed lightweight online test authoring and execution system, its key implementation features, technical architecture using Vue, Java, and MongoDB, and the resulting efficiency gains for development teams.
This guide explains how to set up the mongo_monitor tool—a PHP‑based graphical monitor for MongoDB—by installing required PHP extensions, configuring a MySQL schema, adding MongoDB credentials, customizing email and WeChat alerts, scheduling data collection via cron, and accessing the web dashboard.
This article explores multiple backend strategies for implementing a location‑based “nearby users” service, covering pure MySQL queries, MySQL combined with GeoHash, Redis Geo commands, and MongoDB geospatial indexes, explaining design principles, pros and cons, and providing complete code examples for each approach.
This article provides a comprehensive step‑by‑step guide to installing Scrapy, understanding its core components and processing flow, creating a weather‑data crawling project, writing items, settings, middlewares, spiders, running the crawler, exporting results, and storing the scraped data into MongoDB.
This article details how to build a Node.js web crawler for Indeed job listings, covering entry page selection, HTML parsing with Cheerio, request handling, MongoDB task storage, and a modular architecture that extracts city, category, search, brief, and detail data for a searchable job engine.
This article walks through setting up a comprehensive testing workflow for a Node.js backend, covering Jest configuration, unit and integration tests with SuperTest, in‑memory MongoDB, login helpers, mocking, snapshot testing, coverage reporting, CI integration, and the adoption of TDD/BDD practices.
This article explains the motivations for moving a high‑volume operation‑log system from MongoDB to Elasticsearch, outlines the existing architecture, details capacity planning, index design, and a step‑by‑step migration process using Kafka, DataX, and Spring Boot, and shares the performance gains and lessons learned.
This tutorial walks you through creating a web‑based employee management system that demonstrates MongoDB CRUD operations using Python, Flask, and Pipenv, covering project setup, environment configuration, code implementation for querying, adding, updating, and soft‑deleting records, and how to run the application.
This comprehensive guide introduces NoSQL concepts, classifies non‑relational databases, explains why MongoDB is suited for loosely structured data, walks through Windows and Linux installations, demonstrates using Robo 3T, and covers all CRUD operations, queries, updates, deletions, and data de‑duplication with practical code examples.
This tutorial explains how to install PyMongo, connect to local or remote MongoDB instances, choose databases and collections, and perform all common CRUD operations—including inserts, queries, updates, deletions, and special cases—using Python code examples and practical tips.
This comprehensive guide introduces MongoDB, explains NoSQL classifications, walks through Windows and Linux installations, demonstrates using the Robo 3T GUI, and covers essential CRUD operations, queries, indexing, sorting, counting, and data deduplication with clear code examples and screenshots.
This article provides a comprehensive, step‑by‑step tutorial for installing and configuring the Yapi API management platform on a CentOS 7.6 server, covering system prerequisites, Node.js and MongoDB setup, environment configuration, deployment commands, and common error troubleshooting.
The article examines why upgrading a three‑shard MongoDB cluster from version 3.2 to 4.0 causes CPU usage to jump from 10 % to 40 %, attributing the increase to more frequent moveChunk operations and the associated deletion workload, and explains the underlying balancer threshold differences between the versions.
The article recounts Olery’s five‑year evolution from a Ruby‑centric stack using MongoDB and MySQL to a PostgreSQL‑based architecture, detailing schema‑less pitfalls, database requirements, migration strategies, code adaptations, and the measurable performance gains achieved after the transition.
This article introduces Docker as a leading container platform, explains its core concepts, architecture components, and common commands, and provides step‑by‑step tutorials for deploying a Node.js application and MongoDB using Dockerfile, Docker Compose, and related tools.
In his CNBPS 2019 keynote, MongoDB architect Song Zhiqi discusses how the shift to cloud‑native architectures has amplified data volume and variety, outlines the key challenges such as rapid rollout, downtime, and unstructured data, and explains how MongoDB’s flexible, high‑availability document model addresses these issues while supporting modern micro‑service and Kubernetes ecosystems.
This article details how a high‑traffic MongoDB sharded cluster exceeding one million TPS was optimized through software‑level tweaks, configuration changes, WiredTiger storage‑engine tuning, and hardware upgrades, resulting in latency reductions from hundreds of milliseconds to a few milliseconds and significantly improved stability.
This multi‑part guide explains how to model One‑to‑N relationships in MongoDB, covering basic patterns for one‑to‑few, one‑to‑many, and one‑to‑squillions, then advancing to two‑way referencing and denormalization, and finally offering a concise set of rules of thumb for choosing the right schema design.
The IntelliJ IDEA 2019.3 update brings faster startup, reduced memory usage, enhanced UI responsiveness, support for new microservice frameworks like Micronaut, Quarkus, Helidon, added MongoDB integration, numerous quality improvements, and a host of important bug fixes across platforms.
This guide details a Python‑based Scrapy spider that crawls Sina Weibo user profiles, posts, followers and followings from the WAP site, explains the required environment, configuration steps, and the MongoDB schema used to store the collected data.
This guide explains how the mongoose-modified-at plugin automatically records publication timestamps for MongoDB documents, covering installation, schema configuration, API options, simplified usage, async support, compatibility with Mongoose 4.x, and test‑coverage details.
A MongoDB shard node’s logs unexpectedly turned into PCX image files due to improper log rotation using echo, causing CPU spikes and slow‑query analysis failures; the investigation reproduces the issue, explains the header corruption, and presents a SIGUSR1‑based solution to restore proper ASCII logs and retrieve the needed time‑range data.
Maoyan Entertainment created the “Tangtu” mini‑program operation tool with WeChat Cloud Development, letting operations and product managers visually design, edit and publish holiday activities via cloud storage, database and functions, cutting staff from three to one, slashing development time and cost while highlighting the need for explicit environment variables and careful migration from traditional MySQL services.
This article provides an in‑depth overview of MongoDB’s aggregation framework, explaining the concepts of pipelines and stages such as $match, $group, $project, $lookup, $unwind, and $out, and includes practical code examples, syntax details, and comparisons to SQL aggregation.
This article explains how MongoDB's nearest mode achieves proximity‑aware reads across multiple data centers by analyzing the internal mongos and driver code, detailing latency collection, smoothing algorithms, node selection logic, and providing configuration recommendations for latency‑sensitive workloads.
This article analyzes the performance bottlenecks of a MongoDB‑based CMDB under high write concurrency, explains index structures and storage, demonstrates how to identify and eliminate full‑table scans and redundant multikey indexes, and shows the resulting reduction in slow‑log volume and CPU usage.
This article presents a Java MongoDB utility comprising a static helper class and a MongoObject wrapper, explains methods for server and credential handling, client creation, collection access, and demonstrates usage with a sample main program and its output.
A MongoDB client reported severe chunk imbalance and nightly balancer migration failures in a sharded cluster, which were traced to a known bug causing conflicting operations, and the issue was resolved by disabling the balancer for the affected collection and upgrading the cluster to version 3.4.11 or later.
This article demonstrates building a Python web scraper to collect JD.com product reviews, extract product IDs, store comments in MongoDB, clean color and size data, and visualize the most popular colors and sizes using matplotlib, providing a complete end‑to‑end data analysis pipeline.
This article analyzes MongoDB sort operation memory limits, explains why queries may exceed the 32 MB in‑memory sort threshold, demonstrates how to inspect and adjust server parameters, create appropriate compound indexes, and use allowDiskUse in aggregation pipelines to avoid sort‑related errors.
The article explains how MongoDB Change Streams, introduced in version 3.6 and expanded in 4.0, enable near‑real‑time subscription to collection, database, and cluster changes, discusses implementation details, options, code examples in the mongo shell and Python, and provides practical testing insights and driver compatibility notes.
The June DB‑Engines ranking shows Oracle, MySQL and Microsoft SQL Server holding the top three spots with modest score gains, while PostgreSQL and MongoDB emerge as rising stars despite recent score drops, and cloud providers dominate the product landscape, reshaping the future of database services.
This tutorial walks through integrating MongoDB into a Spring Boot mall project, covering installation, configuration, Spring Data MongoDB usage, defining document and repository classes, implementing service and controller layers, and testing CRUD operations for product browsing records.
This article traces the historical laws that drove computing growth, examines how Redis, MongoDB and Memcached evolved, compares client‑side, proxy and compute‑storage‑separated architectures, evaluates their trade‑offs, and answers common questions about cloud‑based distributed databases.
This article explains what GraphQL is, how it solves common REST API problems, details its request structure, schema, type system, fragments, aliases, interfaces, unions, and resolvers, and provides a step‑by‑step tutorial for creating a GraphQL server using ThinkJS, MongoDB, and Apollo Server, while also outlining its advantages and drawbacks.
The Q1 2019 DB‑Engines ranking shows Oracle, MySQL, SQL Server, PostgreSQL and MongoDB all gaining points, highlights Oracle's autonomous database boost, details its cloud‑centric financial shift, and underscores the rapid growth of open‑source databases like PostgreSQL, MongoDB, Redis and Elasticsearch.
This article explains how MongoDB's mongos router manages client‑to‑mongos and mongos‑to‑mongod connections, compares the default per‑connection‑per‑thread model with the adaptive thread‑pool introduced in version 3.6, details the internal traditional and ASIO connection pools, relevant configuration parameters, and provides practical guidance on interpreting connection‑pool statistics.
This tutorial explains how to extract Meituan Takeout app comments by analyzing Ajax requests, constructing dynamic URLs, parsing JSON with regular expressions, and storing the results in text files and MongoDB using Python.
This article explains the MEAN stack—MongoDB, Express.js, AngularJS, and Node.js—detailing each component, comparing it with LAMP/LNMP, and highlighting its JavaScript‑centric, cost‑effective, open‑source advantages for modern web development.
MongoDB changed its open‑source license to the SSPL to curb cloud providers, prompting AWS to launch its own compatible DocumentDB fork, while industry leaders debate the move’s impact on open‑source freedom, developer choice, and MongoDB’s market performance.
This article walks through building a novel‑site crawler using MongoDB, detailing how to extract category links, manage URL states across multiple processes, and handle deduplication, while sharing screenshots of the framework, database logic, and final results.
The 2018 DB-Engines ranking crowned PostgreSQL as the top DBMS, highlighting its 30‑year evolution, strong community, and expanding features, while MongoDB and Redis secured the runner‑up and third places respectively, and the January 2019 popularity scores showed continued shifts among major database systems.
The 2018 3306π Shenzhen annual conference, co‑hosted by the 3306π community, Zhishu Hall and vivo, attracted over 150 attendees and featured expert talks on MySQL 8.0, open‑source data‑transfer middleware, TDSQL for finance, RadonDB, InnoDB enhancements, large‑scale Redis clusters, and Youzan database operations, with presentation materials available online.
This tutorial walks through extracting Python job postings from Zhaopin, storing them in MongoDB, cleaning the data with pandas, visualizing national and city‑level salary distributions, and generating word clouds of required skills using matplotlib and wordcloud, providing a complete end‑to‑end data analysis pipeline.
This article outlines MongoDB's key features, describes a real‑world outage caused by misconfigured connection limits, details the root‑cause analysis and temporary remediation, and presents a comprehensive set of configuration, sharding, and hardware optimizations that dramatically improved the system's reliability and throughput.
This guide explains why the community edition of MongoDB lacks native hot backup, how Percona MongoDB adds online backup support, the underlying backup and restore principles, and provides a step‑by‑step PHP script with environment setup, configuration, execution, and scheduling instructions.
This tutorial walks through persisting Domain‑Driven Design aggregates by first explaining aggregates and aggregate roots, then showing Java class examples, followed by practical JPA/Hibernate integration challenges and a complete MongoDB document‑store solution, highlighting trade‑offs and best practices.
This article shows how to use Python to scrape Zhihu answers, store them in MongoDB, filter for short high‑upvote replies, and then presents a collection of programmer‑centric jokes that illustrate the kind of "god replies" the crawler can retrieve.
Since 2017, Coinbase has faced rapid cryptocurrency‑driven traffic growth, prompting a series of backend engineering improvements—including database upgrades, monitoring enhancements, relationship refactoring, caching, and a custom traffic capture‑replay system—to ensure reliability and scalability during demand spikes.
This article walks through building a high‑performance novel‑site crawler using MongoDB, detailing the extraction of category links, multi‑process/thread URL management, database operations, and the final deduplication results, while illustrating each step with diagrams and screenshots.
This article explains the performance bottlenecks of MongoDB's geoNear queries in high‑traffic LBS services, analyzes why dense point clusters cause massive scans, and details the introduction of hintScan and hintCorrectNum parameters that reduced scan size and increased QPS by more than tenfold, even outperforming Redis 3.2.
This article details the preparation of the development environment, choice of Go and gopacket, MongoDB integration, the multi‑threaded architecture for real‑time packet capture, and a series of performance optimizations addressing slow logs, packet loss, and CPU usage.
This article explains OpenStack's Ceilometer service, detailing its role in metering, monitoring, and alarming, describing its main components, deployment considerations, and the two data‑collection approaches (Push and Poll) along with the processing pipeline that stores metrics in MongoDB.
This article demonstrates how to extract 1,000 short movie reviews stored in MongoDB, apply Chinese word segmentation using Jieba, select the top 50 terms, generate a visual word cloud, and perform additional analyses such as top‑liked comments and 15‑day comment volume trends.