scalable architecture

JD Tech

May 17, 2024 · Artificial Intelligence

Optimizing JD Advertising Retrieval Platform: Balancing Compute, Data Scale, and Iterative Efficiency

The article details how JD's advertising retrieval platform tackles the core challenge of balancing limited compute resources with massive data by optimizing compute allocation, improving model scoring efficiency, and enhancing iteration speed through distributed execution graphs, adaptive algorithms, and platform‑level infrastructure improvements.

ANNSearchadvertising

0 likes · 24 min read

Optimizing JD Advertising Retrieval Platform: Balancing Compute, Data Scale, and Iterative Efficiency

Architecture & Thinking

Feb 13, 2024 · Backend Development

How to Evolve High‑Traffic Data Architecture: From Simple Reads to Decentralized Caching

This article explains how internet‑scale services can progressively upgrade their data architecture—from a single read/write instance to read‑write separation, multi‑region “two‑site three‑center” designs, cache fallback, and local decentralised caching—to achieve high availability and scalability.

High AvailabilityRead-Write Separationbackend

0 likes · 6 min read

How to Evolve High‑Traffic Data Architecture: From Simple Reads to Decentralized Caching

JD Retail Technology

Mar 2, 2023 · Databases

Evolution of JD VOP Message Warehouse: From V1.0 to V3.0+ with Database Sharding and Performance Optimization

This article details the architectural evolution of JD's VOP message warehouse, describing the challenges of massive data volumes, the transition from V1.0 to V3.0+ through database sharding, MongoDB adoption, traffic governance, stability improvements, and cost reduction strategies, while presenting performance metrics and future outlook.

Message QueueMongoDBbackend systems

0 likes · 17 min read

Evolution of JD VOP Message Warehouse: From V1.0 to V3.0+ with Database Sharding and Performance Optimization

vivo Internet Technology

Nov 16, 2022 · Big Data

Vivo Hawking A/B Experiment Platform: Architecture, Practices, and Solutions

The Vivo Hawking platform provides a company‑wide, one‑stop A/B testing solution with a layered architecture, covariate‑balanced split algorithms, real‑time monitoring, and unified SDKs for Android, Java and H5, enabling thousands of daily experiments, automated analysis, and rapid product iteration across multiple departments.

A/B testingCovariate balancingHive

0 likes · 22 min read

Vivo Hawking A/B Experiment Platform: Architecture, Practices, and Solutions

Architecture Digest

Sep 7, 2022 · Backend Development

Building a High-Performance Scalable Instant Messaging System with Go and WebSocket

This article guides readers through the design and implementation of a high‑performance, scalable instant‑messaging (IM) system using Go, detailing WebSocket protocol fundamentals, server‑side architecture, authentication, message handling, code examples, and optimization strategies for production deployment.

GoInstant MessagingReal-time Communication

0 likes · 39 min read

Building a High-Performance Scalable Instant Messaging System with Go and WebSocket

DeWu Technology

Aug 19, 2022 · Big Data

DeWu Reach Strategy Platform and HBase Buffer Pool Architecture

The DeWu Reach Strategy platform uses a task‑strategy‑action model and an HBase‑backed buffer pool that temporarily stores billions of user records, enabling large‑scale algorithmic push, AB testing, and dynamic horizontal scaling while ensuring even data distribution and low‑latency processing.

Algorithmic PersonalizationBig DataHBase

0 likes · 9 min read

DeWu Reach Strategy Platform and HBase Buffer Pool Architecture

vivo Internet Technology

Mar 30, 2022 · Backend Development

Design of a Bloom Filter‑Based Video Recommendation Deduplication Service for Short Video Platforms

The paper proposes a Bloom‑filter‑based deduplication service for short‑video recommendation that moves three‑month playback histories to disk‑backed Bloom filters while keeping the latest 100 served IDs in Redis, employing write batching, sharding, expiration policies, and an incremental migration strategy to replace memory‑intensive Redis ZSets and dramatically reduce storage costs.

Bloom FilterRedisdata migration

0 likes · 21 min read

Design of a Bloom Filter‑Based Video Recommendation Deduplication Service for Short Video Platforms

DaTaobao Tech

Mar 17, 2022 · Cloud Native

NextRPC: Multi‑Stage RPC Model for Scalable Transaction and Recommendation Services

NextRPC is a multi‑stage RPC model that delivers partial responses over multiple network channels, improving latency and conversion in Taobao’s transaction and recommendation services; it employs a hybrid asynchronous streaming and parallel execution architecture with client‑side orchestration and server‑side sub‑request handling, achieving over 5% UV lift and up to 25% recommendation uplift.

AlibabaAsynchronous StreamingRPC

0 likes · 8 min read

NextRPC: Multi‑Stage RPC Model for Scalable Transaction and Recommendation Services

IT Architects Alliance

Feb 4, 2022 · Backend Development

Designing a Scalable Architecture for Million‑Level DAU Systems

The article outlines a comprehensive backend architecture for handling million‑to‑tens‑of‑million daily active users, covering DNS routing, L4/L7 load balancing, monolithic versus microservice deployment, caching, database sharding, hybrid‑cloud strategies, elastic scaling, and multi‑level degradation mechanisms.

Load Balancingdatabase shardingelastic scaling

0 likes · 11 min read

Designing a Scalable Architecture for Million‑Level DAU Systems

High Availability Architecture

Jan 12, 2022 · Cloud Native

Designing a Scalable Architecture for Million‑Level DAU Internet Applications

The article explains how to build a highly available, horizontally scalable architecture for million‑level daily active users by combining DNS routing, L4/L7 load balancing, micro‑service decomposition, caching, sharded databases, hybrid‑cloud deployment, elastic scaling and multi‑level degradation strategies.

High AvailabilityLoad Balancingcaching

0 likes · 11 min read

Designing a Scalable Architecture for Million‑Level DAU Internet Applications

Architects' Tech Alliance

Sep 7, 2021 · Fundamentals

Understanding Fat-Tree (CLOS) Network Architecture for Data Centers

The article explains the Fat-Tree (CLOS) network topology introduced in 2008, describing its non‑convergent bandwidth design, three‑layer structure, practical benefits, common configurations, and limitations, while also providing references and visual illustrations of the architecture.

CLOSFat TreeNetwork Topology

0 likes · 7 min read

Understanding Fat-Tree (CLOS) Network Architecture for Data Centers

Beike Product & Technology

Nov 2, 2020 · Artificial Intelligence

Beike Commercialization Strategy Algorithm Platform: Architecture, AI Techniques, and System Evolution

This presentation details Beike's AI‑driven commercial strategy platform, covering business scenarios, the evolution of its architecture from 2018 to 2020, the challenges faced, the redesign into online, near‑real‑time, and offline layers, key technologies such as vector search, model serving, and microservice governance, as well as performance gains and future directions.

AIReal Estateadvertising

0 likes · 23 min read

Beike Commercialization Strategy Algorithm Platform: Architecture, AI Techniques, and System Evolution

Java Architect Essentials

Sep 16, 2020 · Big Data

Elasticsearch Adoption and Architecture Cases in Major Chinese Companies

This article reviews how major Chinese companies such as JD.com, Ctrip, Quark, 58.com, and Didi have adopted Elasticsearch for large‑scale search, log analysis, and real‑time analytics, detailing their cluster architectures, scaling strategies, and operational practices.

Big DataElasticsearchLog Analysis

0 likes · 11 min read

Elasticsearch Adoption and Architecture Cases in Major Chinese Companies

DataFunTalk

Aug 21, 2020 · Big Data

Design and Implementation of 58.com Commercial DMP Platform

This talk presents the architecture, feature extraction, storage, real-time computation, monitoring, and optimization strategies of 58.com’s commercial DMP platform, detailing business requirements, system design across data, storage, compute, and service layers, and future plans for unified services and advanced analytics.

Big DataDMPFeature Engineering

0 likes · 13 min read

Design and Implementation of 58.com Commercial DMP Platform

Architecture Digest

Jun 21, 2019 · Backend Development

Design and Implementation of a High‑Availability Scalable IM Group‑Chat Messaging System

This article presents a comprehensive design and implementation of a high‑availability, horizontally scalable instant‑messaging group‑chat system, detailing its architecture, component interactions, scaling strategies, reliability mechanisms, and extensions for offline and single‑chat messaging.

Group ChatIMbackend

0 likes · 48 min read

Design and Implementation of a High‑Availability Scalable IM Group‑Chat Messaging System

58 Tech

Apr 9, 2019 · Backend Development

Optimizing Group Chat Performance in an Instant Messaging Backend

This article analyzes the challenges of scaling group chat in an instant messaging system and presents architectural optimizations—including shared message storage, periodic conversation list updates, offline count handling, and version‑based incremental sync—to reduce write and read amplification while improving overall performance.

Group ChatMessage QueueWrite Amplification

0 likes · 12 min read

Optimizing Group Chat Performance in an Instant Messaging Backend

Architecture Digest

Apr 2, 2019 · Databases

Designing Scalable Database Architecture for High‑Concurrency Systems

This article explains how to design a database architecture that can handle millions of daily active users and tens of thousands of concurrent requests by using multi‑server sharding, extensive table partitioning, read‑write separation, and distributed unique‑ID generation techniques such as Snowflake.

Read-Write SeparationSnowflake IDdatabase sharding

0 likes · 20 min read

Designing Scalable Database Architecture for High‑Concurrency Systems

iQIYI Technical Product Team

Mar 15, 2019 · Cloud Computing

Design and Architecture of QLive Large‑Scale Live Streaming Service

The QLive service powers iQIYI’s massive live‑streaming events—such as the Spring Festival Gala—by combining vertical and horizontal scaling, a three‑layer architecture with dual data‑center isolation, multi‑level caching, circuit‑breaker/degradation controls, and a Flume‑Kafka‑Hive monitoring pipeline to sustain over 400 k QPS and 99.9999 % availability.

Live Streamingcachingfault tolerance

0 likes · 9 min read

Design and Architecture of QLive Large‑Scale Live Streaming Service

Mike Chen's Internet Architecture

Nov 11, 2018 · Backend Development

Technical Architecture Behind Alibaba's Double 11 Flash Sale

The article analyzes the massive technical challenges of Alibaba's Double 11 flash‑sale event and explains how cloud elasticity, distributed messaging, containerization, real‑time data processing, AI, front‑end optimization, caching, monitoring, and database sharding together enable billions of transactions within minutes.

AlibabaDouble 11Message Queue

0 likes · 9 min read

Technical Architecture Behind Alibaba's Double 11 Flash Sale

Architecture Digest

Jun 18, 2018 · Operations

Design and Optimization of Large‑Scale Log Systems

This article examines the challenges of handling massive log data in high‑traffic e‑commerce platforms and presents a comprehensive architecture, optimization strategies, and practical implementations—including Rsyslog, Kafka, Fluentd, and the ELK stack—to improve scalability, performance, and reliability of log management systems.

Big DataELKKafka

0 likes · 17 min read

Design and Optimization of Large‑Scale Log Systems