58 Cloud DB Platform: Architecture, Automation, and Intelligent Operations
The article presents a detailed case study of the 58 Cloud DB Platform, describing its architecture, automated workflow using Celery and Ansible, and intelligent features such as server selection and alarm merging powered by machine‑learning, highlighting how it streamlines MySQL, Redis, and MongoDB operations for developers and DBAs.
The 58 Cloud DB Platform, built by the DBA team of 58 Group, provides high‑reliability and high‑performance MySQL, Redis, and MongoDB cloud services to support various business lines, offering self‑service resource requests, real‑time monitoring, slow‑SQL analysis, and other operational tools for developers, while enabling DBAs to automate repetitive tasks.
Born from the rapid expansion and consolidation of multiple subsidiaries, the platform addresses challenges such as inconsistent DB operation standards, numerous manual tickets, and lack of centralized management, prompting the need for an automated operations platform.
The overall architecture consists of Web services (React front‑end, Python back‑end behind Nginx), download services, API proxy services, automation services, and machine‑learning services. Automation core uses Celery for task scheduling, with Ansible and custom scripts handling server configuration, database actions, and HTTP calls, while logs are streamed to the web UI via WebSocket.
Automation faces three main issues: wide coverage across server and DB layers, diverse operation types with varying complexity, and real‑time log display, which are mitigated by combining Celery, Redis queues, and a lightweight messaging mechanism.
Intelligent exploration includes a supervised‑learning based server‑selection model that learns from deployment data to recommend optimal servers, and an unsupervised hierarchical clustering algorithm for alarm merging, both improving operational efficiency and reducing alert noise.
In summary, the platform integrates multiple functional modules—high‑availability, monitoring, backup, and one‑click operations—across MySQL, Redis, and MongoDB, and continues to evolve with more self‑service and AI‑driven capabilities.
58 Tech
Official tech channel of 58, a platform for tech innovation, sharing, and communication.
How this landed with the community
Was this worth your time?
0 Comments
Thoughtful readers leave field notes, pushback, and hard-won operational detail here.