JD.com's Database Automation and ContainerDB: Evolution of Intelligent Database Management

This article provides a comprehensive overview of JD.com's database automation and intelligent management systems. It begins with an introduction to the JD.com Database Technology Department, which is responsible for providing efficient and stable database services and developing database ecosystem products.

The article then discusses the evolution of database automation at JD.com, which began in 2012. It covers the development of the JD.com MySQL Database Management Platform (DBS), which includes a complete asset management system, database process management system, database monitoring system, database fault management system, database reporting system, elastic database system, and database auxiliary operation and maintenance tools.

The core components of the DBS platform are then detailed, including:

1. Metadata Management: Covers multiple dimensions including data center and host, business, cluster, instance, database, and table.

2. Automated Deployment: Includes server application, database instance deployment, data synchronization, consistency verification, splitting, and switching operations.

3. Intelligent Analysis and Diagnostics: Covers database monitoring indicator collection, diagnostic analysis, fault self-healing, and trend analysis.

4. Intelligent Switching System: Provides automatic and semi-automatic switching methods for database high availability.

5. Database Automated Backup and Recovery: Includes backup strategy management, backup details, backup blacklist management, and recovery details.

The article then transitions to discussing the evolution from traditional database containerization to ContainerDB. It outlines the problems with the previous system, including large resource allocation granularity, severe resource waste, and static resource scheduling.

ContainerDB is presented as a solution that provides intelligent database services with elastic scheduling. It features:

- Streamlined resource delivery

- Load-based elastic scheduling

- Online expansion

- Online self-healing

- Online access

The article concludes with a vision for the future of JD.com's database services, emphasizing goals of being smarter, quicker, cheaper, more user-friendly, and more open.