Tag

streaming architecture

0 views collected around this technical thread.

DataFunTalk
DataFunTalk
Jul 25, 2024 · Big Data

Real‑time Data Warehouse Evolution with Data Lake: Challenges, Solutions, and Future Outlook

This article presents a comprehensive overview of JD Tech's real‑time data warehouse evolution, detailing the legacy Lambda architecture, its shortcomings, the integration of a data‑lake‑based solution, iterative redesigns, technical trade‑offs, and future directions for real‑time analytics.

Big DataClickHouseFlink
0 likes · 25 min read
Real‑time Data Warehouse Evolution with Data Lake: Challenges, Solutions, and Future Outlook
High Availability Architecture
High Availability Architecture
May 18, 2021 · Big Data

Design and Optimization of Baidu's Image Processing and Multimodal Retrieval Platform (Imazon)

This article details Baidu's large‑scale image processing and multimodal retrieval system, describing its offline‑online architecture, massive data ingestion pipeline, ANN search techniques, performance metrics, infrastructure components, and a series of optimizations for throughput, cost, and reliability in a high‑volume streaming environment.

BaiduImazonimage processing
0 likes · 12 min read
Design and Optimization of Baidu's Image Processing and Multimodal Retrieval Platform (Imazon)
Byte Quality Assurance Team
Byte Quality Assurance Team
Dec 16, 2020 · Backend Development

Live Streaming Service Overload Incident Caused by Self-Referencing Push Configuration

A sudden surge in live‑stream traffic overloaded the core streaming service because a push configuration mistakenly pointed to the same stream URL, creating a self‑referencing loop that repeatedly generated duplicate streams until the service capacity was exhausted.

Live Streamingbackend bugincident analysis
0 likes · 4 min read
Live Streaming Service Overload Incident Caused by Self-Referencing Push Configuration
Architecture Digest
Architecture Digest
Jul 30, 2020 · Cloud Computing

Design Analysis of Netflix’s Cloud‑Based Microservices Architecture

The article examines Netflix’s migration to AWS and its micro‑service‑based cloud architecture, detailing client, backend, and CDN components, the design goals of high availability, low latency, scalability, and resilience, and how these goals are achieved through services such as EC2, S3, DynamoDB, Cassandra, Zuul, Hystrix, and Open Connect.

AWSHigh AvailabilityNetflix
0 likes · 25 min read
Design Analysis of Netflix’s Cloud‑Based Microservices Architecture
High Availability Architecture
High Availability Architecture
Aug 19, 2016 · Fundamentals

Design and Implementation of a Sub‑500 ms Ultra‑HD Real‑Time Video Transmission System

This article details the architecture, encoding choices, network‑level optimizations, transmission model, measurement methods, and practical pitfalls involved in building a 1080p real‑time video streaming solution that consistently keeps end‑to‑end latency below 500 ms for interactive online education.

H.264Low LatencyUDP
0 likes · 27 min read
Design and Implementation of a Sub‑500 ms Ultra‑HD Real‑Time Video Transmission System