This article explains how Vivo designed a company‑wide comment middle‑platform, chose MySQL and MongoDB, deep‑dived into MongoDB cluster architecture, shard key strategies, and practical solutions for scaling, migration, and high availability in a high‑traffic environment.
This article walks through building a Python web crawler that extracts forum post comments into MongoDB, covering project goals, environment setup, site structure analysis, Scrapy and Selenium integration, data storage design, handling anti‑scraping measures, and performance optimization with multithreading.
This tutorial walks you through upgrading Spring Boot, introduces MongoDB basics, and provides a hands‑by‑step guide to adding the spring‑boot‑starter‑data‑mongodb dependency, defining entity and repository classes, writing unit tests, and configuring connection properties for robust backend data management.
This article details Vivo's journey in building a company‑wide comment platform, explaining why MongoDB was chosen over MySQL, how its sharded cluster is structured, the challenges of shard‑key selection, and the practical steps taken to scale and maintain the system.
This guide walks through migrating documents from a MongoDB 3.4.1 cluster to an Apache CouchDB 2.2 cluster using a Python script that leverages pymongo and CouchDB’s REST API, covering environment setup, migration steps, code execution, and verification of transferred data.
This article details OPPO's journey of adopting MongoDB at massive scale, addressing common misconceptions, designing multi‑data‑center active‑active architectures, optimizing thread models and migration processes, and applying performance‑boosting techniques that yielded multi‑fold improvements for trillion‑row clusters.
This article systematically refutes ten widespread misconceptions about MongoDB—covering scalability, versioning, data format, transactions, relationships, sharding, security, data loss, and suitability—while explaining its architecture, BSON storage, and best‑practice usage with illustrative code examples.
This article provides a detailed Linux tutorial for installing MongoDB, disabling the firewall, extracting the package, setting environment paths, creating data and log directories, editing the configuration file, and launching the database both in foreground and as a background service.
This guide reviews thirteen popular MongoDB graphical tools—covering open‑source and commercial options, their key features, platform support, and download links—to help developers and DBAs choose the most suitable visual interface for managing MongoDB databases.
This article explains how Debezium's MongoDB Source Connector captures change events from replica sets or sharded clusters, streams them to Kafka topics, and provides detailed configuration, deployment, monitoring, and troubleshooting steps for building reliable change‑data‑capture pipelines.
This article explains how Spark can be combined with MongoDB for large‑scale data processing, covering Spark fundamentals, comparisons with HDFS, practical integration patterns, performance benefits, real‑world case studies, and detailed code examples for deployment and analytics.
The article describes the challenges of maintaining test cases amid organizational changes and introduces a functional test case platform that centralizes case storage, supports version‑driven updates, enables reuse of business modules and base components, and outlines its backend MongoDB design, frontend mind‑map UI, and future roadmap.
This guide explains MongoDB replica set fundamentals, walks through local deployment of a primary‑secondary‑secondary cluster, demonstrates automatic failover, and details write concern and read preference options—including member attributes, connection string parameters, and shell commands—for reliable high‑availability data handling.
This article explains how to scrape detailed job description and address information from online job portals, use Python libraries such as requests, BeautifulSoup4, and pymongo for crawling, and then clean and normalize the collected data including publish dates, salaries, and work‑experience levels before storing it in MongoDB.
This comprehensive guide explains what NoSQL is, contrasts non‑relational and relational databases, outlines the main representatives of each, dives deep into MongoDB architecture, features, use‑cases and limitations, and also covers MySQL fundamentals, replication, backup, and common monitoring tools like Prometheus and Zabbix.
This guide walks you through installing the Go MongoDB driver, establishing connections, and performing full CRUD operations—including inserting single and multiple documents, querying, updating, and deleting records—while also showing how to retrieve server status and explaining BSON handling in Go.
MongoDB’s flexible, schema‑less design offers performance benefits but can become a maintenance nightmare as projects grow, so the article explains why introducing external schema protocols like Google’s Protobuf or Facebook’s Thrift provides structure, reduces bugs, and balances flexibility with robustness.
A high‑traffic Java service using MongoDB experienced intermittent latency spikes and a full‑scale outage caused by excessive connection churn, kernel‑level random‑number generation bottlenecks, and mis‑configured client timeouts, which were diagnosed through log analysis, packet captures, and performance testing, leading to concrete mitigation steps.
This guide explains MongoDB 4.2's wildcard indexes, showing how to create single‑field and full‑field wildcard indexes, how they index dynamic schemas, their query behavior for objects and arrays, supported index types, and important limitations such as sparsity and $exists handling.
This article compares the document‑oriented NoSQL databases MongoDB and CouchDB, outlining their architectures, core features, replication and sharding mechanisms, mobile support, and contrasting query approaches with code examples to help choose the appropriate solution for different application scenarios.
This comprehensive tutorial covers MongoDB fundamentals, including CRUD operations, display commands, conditional queries, updates, deletions, essential tools like mongod and mongostat, authentication mechanisms, role definitions, configuration settings, and step‑by‑step user and admin creation for secure database management.
This step‑by‑step tutorial shows how to set up a highly available MongoDB cluster with sharding and replica sets on Ubuntu 18.04, covering key concepts, environment preparation, configuration of config servers, shard replica sets, the mongos router, enabling sharding, testing data distribution, and final deployment tips.
This article explains how to upgrade the think-mongo module for ThinkJS to work with MongoDB 4.x, detailing API changes, new CRUD method mappings, transaction support, and provides code examples for adapting existing projects to the latest MongoDB features.
This guide explains how to set up a PHP‑based web platform that collects MongoDB slow‑query logs via remote profiling, stores them in MySQL, and visualizes the data, including installation of required PHP extensions, database preparation, configuration, cron scheduling, and enabling profiling on MongoDB.
This guide explains MongoDB permission levels, clarifies common misconceptions, and provides step‑by‑step commands to create ordinary, administrative, authorization, and super‑admin users, enable authentication, and verify read/write access across multiple databases.
This article explains why a fast‑growing e‑commerce platform chose MongoDB, covering its high‑availability replica‑set architecture, Raft‑based election algorithm, replica‑set size limits, write‑concern trade‑offs, sharding components and load‑balancing, as well as the flexible document schema with practical code examples.
MongoDB is a versatile NoSQL database that combines relational‑like querying with a flexible BSON document model, offering high performance, easy deployment, rich indexing, replication, and cloud‑scale storage, while supporting multiple programming languages and operating systems.
After upgrading a three‑shard MongoDB cluster from version 3.2 to 4.0, CPU usage jumped from 10 % to 40 % due to more frequent moveChunk operations and the resulting delete workload, as the balancer’s imbalance thresholds changed between versions.
This article explains various MongoDB pagination strategies—including skip/limit, range queries, and sorting—covers performance monitoring with profiling, details index creation and design principles, and describes how to interpret explain plans for efficient query optimization.
This article introduces thirteen popular MongoDB graphical tools—including Robo 3T, Navicat, Compass, NoSQLBooster, ClusterControl, NoSQLClient, Studio 3T, Mongo Management Studio, Aqua Data Studio, phpMoAdmin, Mongotron, Mongolime, and mongo‑express—detailing their key features, platform support, and download links to help users choose the best visual interface for database administration.
This article explains how loop‑based database queries degrade performance and demonstrates three concrete optimizations—using IN clauses in MySQL, aggregation pipelines in MongoDB, and Redis pipelines—to replace repetitive queries with bulk operations, improving speed and maintainability.
This article introduces the community‑maintained SpaceX REST API that aggregates all launch, vehicle, and payload data, explains how to query it using tools like Postman or Python, and provides deployment options via Docker or local npm setup for developers.
This article introduces the community‑maintained r/SpaceX REST API that aggregates every SpaceX rocket datum, explains how to query it via JSON in multiple languages, provides a Python example, and details Docker, local, and Postman deployment options for developers.
This guide walks you through downloading DataGrip, configuring its appearance, creating MySQL and MongoDB data sources, managing tables, applying powerful SQL editing shortcuts, and leveraging export and execution‑plan features to write higher‑quality database code.
This guide explains how to install the Elasticsearch Python client, build a wrapper class for index management and CRUD operations, import data from MongoDB, use a Celery‑based crawler to harvest Baidu Baike content, and expose search functionality through Flask or other Python web frameworks.
The article presents Ctrip's platform-driven API automated testing solution, detailing the challenges of traditional script-based testing, the proposed lightweight online test authoring and execution system, its key implementation features, technical architecture using Vue, Java, and MongoDB, and the resulting efficiency gains for development teams.
This guide explains how to set up the mongo_monitor tool—a PHP‑based graphical monitor for MongoDB—by installing required PHP extensions, configuring a MySQL schema, adding MongoDB credentials, customizing email and WeChat alerts, scheduling data collection via cron, and accessing the web dashboard.
This article explores multiple backend strategies for implementing a location‑based “nearby users” service, covering pure MySQL queries, MySQL combined with GeoHash, Redis Geo commands, and MongoDB geospatial indexes, explaining design principles, pros and cons, and providing complete code examples for each approach.
This article provides a comprehensive step‑by‑step guide to installing Scrapy, understanding its core components and processing flow, creating a weather‑data crawling project, writing items, settings, middlewares, spiders, running the crawler, exporting results, and storing the scraped data into MongoDB.
This article details how to build a Node.js web crawler for Indeed job listings, covering entry page selection, HTML parsing with Cheerio, request handling, MongoDB task storage, and a modular architecture that extracts city, category, search, brief, and detail data for a searchable job engine.
This article walks through setting up a comprehensive testing workflow for a Node.js backend, covering Jest configuration, unit and integration tests with SuperTest, in‑memory MongoDB, login helpers, mocking, snapshot testing, coverage reporting, CI integration, and the adoption of TDD/BDD practices.
This article explains the motivations for moving a high‑volume operation‑log system from MongoDB to Elasticsearch, outlines the existing architecture, details capacity planning, index design, and a step‑by‑step migration process using Kafka, DataX, and Spring Boot, and shares the performance gains and lessons learned.
This tutorial walks you through creating a web‑based employee management system that demonstrates MongoDB CRUD operations using Python, Flask, and Pipenv, covering project setup, environment configuration, code implementation for querying, adding, updating, and soft‑deleting records, and how to run the application.
This comprehensive guide introduces NoSQL concepts, classifies non‑relational databases, explains why MongoDB is suited for loosely structured data, walks through Windows and Linux installations, demonstrates using Robo 3T, and covers all CRUD operations, queries, updates, deletions, and data de‑duplication with practical code examples.
This tutorial explains how to install PyMongo, connect to local or remote MongoDB instances, choose databases and collections, and perform all common CRUD operations—including inserts, queries, updates, deletions, and special cases—using Python code examples and practical tips.
This comprehensive guide introduces MongoDB, explains NoSQL classifications, walks through Windows and Linux installations, demonstrates using the Robo 3T GUI, and covers essential CRUD operations, queries, indexing, sorting, counting, and data deduplication with clear code examples and screenshots.
This article provides a comprehensive, step‑by‑step tutorial for installing and configuring the Yapi API management platform on a CentOS 7.6 server, covering system prerequisites, Node.js and MongoDB setup, environment configuration, deployment commands, and common error troubleshooting.
The article examines why upgrading a three‑shard MongoDB cluster from version 3.2 to 4.0 causes CPU usage to jump from 10 % to 40 %, attributing the increase to more frequent moveChunk operations and the associated deletion workload, and explains the underlying balancer threshold differences between the versions.
The article recounts Olery’s five‑year evolution from a Ruby‑centric stack using MongoDB and MySQL to a PostgreSQL‑based architecture, detailing schema‑less pitfalls, database requirements, migration strategies, code adaptations, and the measurable performance gains achieved after the transition.
This article introduces Docker as a leading container platform, explains its core concepts, architecture components, and common commands, and provides step‑by‑step tutorials for deploying a Node.js application and MongoDB using Dockerfile, Docker Compose, and related tools.
In his CNBPS 2019 keynote, MongoDB architect Song Zhiqi discusses how the shift to cloud‑native architectures has amplified data volume and variety, outlines the key challenges such as rapid rollout, downtime, and unstructured data, and explains how MongoDB’s flexible, high‑availability document model addresses these issues while supporting modern micro‑service and Kubernetes ecosystems.
This article details how a high‑traffic MongoDB sharded cluster exceeding one million TPS was optimized through software‑level tweaks, configuration changes, WiredTiger storage‑engine tuning, and hardware upgrades, resulting in latency reductions from hundreds of milliseconds to a few milliseconds and significantly improved stability.
This multi‑part guide explains how to model One‑to‑N relationships in MongoDB, covering basic patterns for one‑to‑few, one‑to‑many, and one‑to‑squillions, then advancing to two‑way referencing and denormalization, and finally offering a concise set of rules of thumb for choosing the right schema design.
The IntelliJ IDEA 2019.3 update brings faster startup, reduced memory usage, enhanced UI responsiveness, support for new microservice frameworks like Micronaut, Quarkus, Helidon, added MongoDB integration, numerous quality improvements, and a host of important bug fixes across platforms.
This guide details a Python‑based Scrapy spider that crawls Sina Weibo user profiles, posts, followers and followings from the WAP site, explains the required environment, configuration steps, and the MongoDB schema used to store the collected data.
This guide explains how the mongoose-modified-at plugin automatically records publication timestamps for MongoDB documents, covering installation, schema configuration, API options, simplified usage, async support, compatibility with Mongoose 4.x, and test‑coverage details.
A MongoDB shard node’s logs unexpectedly turned into PCX image files due to improper log rotation using echo, causing CPU spikes and slow‑query analysis failures; the investigation reproduces the issue, explains the header corruption, and presents a SIGUSR1‑based solution to restore proper ASCII logs and retrieve the needed time‑range data.
Maoyan Entertainment created the “Tangtu” mini‑program operation tool with WeChat Cloud Development, letting operations and product managers visually design, edit and publish holiday activities via cloud storage, database and functions, cutting staff from three to one, slashing development time and cost while highlighting the need for explicit environment variables and careful migration from traditional MySQL services.
This article provides an in‑depth overview of MongoDB’s aggregation framework, explaining the concepts of pipelines and stages such as $match, $group, $project, $lookup, $unwind, and $out, and includes practical code examples, syntax details, and comparisons to SQL aggregation.
This article explains how MongoDB's nearest mode achieves proximity‑aware reads across multiple data centers by analyzing the internal mongos and driver code, detailing latency collection, smoothing algorithms, node selection logic, and providing configuration recommendations for latency‑sensitive workloads.
This article analyzes the performance bottlenecks of a MongoDB‑based CMDB under high write concurrency, explains index structures and storage, demonstrates how to identify and eliminate full‑table scans and redundant multikey indexes, and shows the resulting reduction in slow‑log volume and CPU usage.
This article presents a Java MongoDB utility comprising a static helper class and a MongoObject wrapper, explains methods for server and credential handling, client creation, collection access, and demonstrates usage with a sample main program and its output.
A MongoDB client reported severe chunk imbalance and nightly balancer migration failures in a sharded cluster, which were traced to a known bug causing conflicting operations, and the issue was resolved by disabling the balancer for the affected collection and upgrading the cluster to version 3.4.11 or later.
This article demonstrates building a Python web scraper to collect JD.com product reviews, extract product IDs, store comments in MongoDB, clean color and size data, and visualize the most popular colors and sizes using matplotlib, providing a complete end‑to‑end data analysis pipeline.
This article analyzes MongoDB sort operation memory limits, explains why queries may exceed the 32 MB in‑memory sort threshold, demonstrates how to inspect and adjust server parameters, create appropriate compound indexes, and use allowDiskUse in aggregation pipelines to avoid sort‑related errors.
This article explains MongoDB 4.0's multi-document transaction support, covering replica set limitations, transaction semantics, required settings, read/write concerns, important configuration parameters, client driver versions, and provides practical shell and Python code examples.
The article explains how MongoDB Change Streams, introduced in version 3.6 and expanded in 4.0, enable near‑real‑time subscription to collection, database, and cluster changes, discusses implementation details, options, code examples in the mongo shell and Python, and provides practical testing insights and driver compatibility notes.
The June DB‑Engines ranking shows Oracle, MySQL and Microsoft SQL Server holding the top three spots with modest score gains, while PostgreSQL and MongoDB emerge as rising stars despite recent score drops, and cloud providers dominate the product landscape, reshaping the future of database services.
This tutorial walks through integrating MongoDB into a Spring Boot mall project, covering installation, configuration, Spring Data MongoDB usage, defining document and repository classes, implementing service and controller layers, and testing CRUD operations for product browsing records.
This article traces the historical laws that drove computing growth, examines how Redis, MongoDB and Memcached evolved, compares client‑side, proxy and compute‑storage‑separated architectures, evaluates their trade‑offs, and answers common questions about cloud‑based distributed databases.
This article explains what GraphQL is, how it solves common REST API problems, details its request structure, schema, type system, fragments, aliases, interfaces, unions, and resolvers, and provides a step‑by‑step tutorial for creating a GraphQL server using ThinkJS, MongoDB, and Apollo Server, while also outlining its advantages and drawbacks.
The Q1 2019 DB‑Engines ranking shows Oracle, MySQL, SQL Server, PostgreSQL and MongoDB all gaining points, highlights Oracle's autonomous database boost, details its cloud‑centric financial shift, and underscores the rapid growth of open‑source databases like PostgreSQL, MongoDB, Redis and Elasticsearch.
This article explains how MongoDB's mongos router manages client‑to‑mongos and mongos‑to‑mongod connections, compares the default per‑connection‑per‑thread model with the adaptive thread‑pool introduced in version 3.6, details the internal traditional and ASIO connection pools, relevant configuration parameters, and provides practical guidance on interpreting connection‑pool statistics.
This tutorial explains how to extract Meituan Takeout app comments by analyzing Ajax requests, constructing dynamic URLs, parsing JSON with regular expressions, and storing the results in text files and MongoDB using Python.
This article explains the MEAN stack—MongoDB, Express.js, AngularJS, and Node.js—detailing each component, comparing it with LAMP/LNMP, and highlighting its JavaScript‑centric, cost‑effective, open‑source advantages for modern web development.
MongoDB changed its open‑source license to the SSPL to curb cloud providers, prompting AWS to launch its own compatible DocumentDB fork, while industry leaders debate the move’s impact on open‑source freedom, developer choice, and MongoDB’s market performance.
This article walks through building a novel‑site crawler using MongoDB, detailing how to extract category links, manage URL states across multiple processes, and handle deduplication, while sharing screenshots of the framework, database logic, and final results.
The 2018 DB-Engines ranking crowned PostgreSQL as the top DBMS, highlighting its 30‑year evolution, strong community, and expanding features, while MongoDB and Redis secured the runner‑up and third places respectively, and the January 2019 popularity scores showed continued shifts among major database systems.
The 2018 3306π Shenzhen annual conference, co‑hosted by the 3306π community, Zhishu Hall and vivo, attracted over 150 attendees and featured expert talks on MySQL 8.0, open‑source data‑transfer middleware, TDSQL for finance, RadonDB, InnoDB enhancements, large‑scale Redis clusters, and Youzan database operations, with presentation materials available online.
MongoDB 4.0 introduces multi‑document ACID transactions with snapshot isolation, supporting replica sets and WiredTiger, and this article explains ACID concepts, outlines limitations, demonstrates session commands, and compares transaction behavior—including conflict detection, repeatable reads, and phantom reads—to MySQL’s implementation.
This tutorial walks through extracting Python job postings from Zhaopin, storing them in MongoDB, cleaning the data with pandas, visualizing national and city‑level salary distributions, and generating word clouds of required skills using matplotlib and wordcloud, providing a complete end‑to‑end data analysis pipeline.
This article outlines MongoDB's key features, describes a real‑world outage caused by misconfigured connection limits, details the root‑cause analysis and temporary remediation, and presents a comprehensive set of configuration, sharding, and hardware optimizations that dramatically improved the system's reliability and throughput.
This guide explains why the community edition of MongoDB lacks native hot backup, how Percona MongoDB adds online backup support, the underlying backup and restore principles, and provides a step‑by‑step PHP script with environment setup, configuration, execution, and scheduling instructions.
This tutorial walks through persisting Domain‑Driven Design aggregates by first explaining aggregates and aggregate roots, then showing Java class examples, followed by practical JPA/Hibernate integration challenges and a complete MongoDB document‑store solution, highlighting trade‑offs and best practices.
This article shows how to use Python to scrape Zhihu answers, store them in MongoDB, filter for short high‑upvote replies, and then presents a collection of programmer‑centric jokes that illustrate the kind of "god replies" the crawler can retrieve.
Since 2017, Coinbase has faced rapid cryptocurrency‑driven traffic growth, prompting a series of backend engineering improvements—including database upgrades, monitoring enhancements, relationship refactoring, caching, and a custom traffic capture‑replay system—to ensure reliability and scalability during demand spikes.
Li Xiaohui shares Tencent Cloud MongoDB’s real‑world mini‑game operations, detailing schema‑free design, sharding, thread‑per‑connection tuning, snapshot‑based read fixes, and table‑level rollback, then demonstrates a one‑click cloud stack that provisions MongoDB, serverless functions, storage, monitoring and security for mini‑program developers.
This article walks through building a high‑performance novel‑site crawler using MongoDB, detailing the extraction of category links, multi‑process/thread URL management, database operations, and the final deduplication results, while illustrating each step with diagrams and screenshots.
This article explains the performance bottlenecks of MongoDB's geoNear queries in high‑traffic LBS services, analyzes why dense point clusters cause massive scans, and details the introduction of hintScan and hintCorrectNum parameters that reduced scan size and increased QPS by more than tenfold, even outperforming Redis 3.2.
This article details the preparation of the development environment, choice of Go and gopacket, MongoDB integration, the multi‑threaded architecture for real‑time packet capture, and a series of performance optimizations addressing slow logs, packet loss, and CPU usage.
This article explains OpenStack's Ceilometer service, detailing its role in metering, monitoring, and alarming, describing its main components, deployment considerations, and the two data‑collection approaches (Push and Poll) along with the processing pipeline that stores metrics in MongoDB.
This article demonstrates how to extract 1,000 short movie reviews stored in MongoDB, apply Chinese word segmentation using Jieba, select the top 50 terms, generate a visual word cloud, and perform additional analyses such as top‑liked comments and 15‑day comment volume trends.
This article describes how to use Python, Selenium, and search‑index services to scrape and visualize popularity data for Chinese tourist spots during the National Day holiday, presenting a ranking of destinations and providing full code examples for data collection, cleaning, and storage.
The 2018 Gdevops Global Agile Operations Summit in Beijing gathered experts who shared practical insights on AIOps, DevOps, cloud‑native databases, MongoDB, TiDB on Kubernetes, SQL optimization, and operational best practices, providing a comprehensive snapshot of modern enterprise operations trends.
The article presents a detailed case study of the 58 Cloud DB Platform, describing its architecture, automated workflow using Celery and Ansible, and intelligent features such as server selection and alarm merging powered by machine‑learning, highlighting how it streamlines MySQL, Redis, and MongoDB operations for developers and DBAs.
This article explains how to design data architecture for microservice systems, covering microservice fundamentals, advantages, decoupling, lightweight APIs, continuous delivery, database per service versus shared databases, polyglot persistence, scaling dimensions, sharding strategies, and why MongoDB is a suitable choice.
This guide explains how to set up a Python‑based log‑analysis tool for web servers, defines key terminology, outlines installation requirements, describes its abstract‑based aggregation features, and demonstrates usage of the accompanying command‑line utility for request, IP, distribution, and detail analysis.
MongoDB 4.0 has been officially released, bringing multi‑document ACID transactions, new aggregation operators, driver compatibility updates, enhanced security features, deprecation of the MMAPv1 storage engine, and broader platform support, while also offering free cloud monitoring for standalone and replica set deployments.
This article examines the requirements of active‑active applications across multiple data centers, compares distributed database architectures—including two‑phase commit, multi‑master, and sharded designs—and explains how MongoDB’s sharding and write/read concerns enable high availability, consistency, and rapid failover in such environments.
This tutorial walks you through creating a reactive Spring WebFlux RESTful API using Spring Boot 2.0 and MongoDB, covering project setup, database connection, model, DAO, controller implementation, and testing the CRUD operations with practical code examples and screenshots.
