Task Processing — 2 Technical Articles

Oct 27, 2020 · Backend Development

How to Build a High‑Performance Async Task Queue with Redis and Node.js

This article explains how to replace a 29‑day serial processing job for 100,000 string records with a Redis‑backed asynchronous task queue powered by Node.js, PM2 clustering, and distributed locking, achieving a ten‑second runtime for 20 sample tasks.

Async QueueNode.jsPerformance Optimization

0 likes · 14 min read

How to Build a High‑Performance Async Task Queue with Redis and Node.js

JD Tech

Aug 3, 2018 · Backend Development

High‑Concurrency Price Protection System: Rate Limiting, Degradation, Caching, Sharding, and Scalable Task Processing

This article describes how JD built a high‑concurrency price‑protection service for the 618 promotion, covering rate‑limiting, degradation, CDN and data caching, database sharding with smooth expansion, and a multi‑stage, fault‑tolerant task‑processing workflow to achieve unlimited scalability.

BackendHigh ConcurrencyTask Processing

0 likes · 13 min read

High‑Concurrency Price Protection System: Rate Limiting, Degradation, Caching, Sharding, and Scalable Task Processing