Tagged articles
real-time video
17 articles · Page 1 of 1
Vidu S1, the new real‑time interactive video generation model from Shengshu Technology, combines voice‑controlled, unlimited‑duration streaming at 540p/25‑42 FPS on consumer GPUs with custom avatars and audio, redefining AI video creation from offline rendering to continuous, responsive digital characters.
AI Video GenerationTurboDiffusionTurboServe
0 likes · 14 min read

The Artic framework redesigns real‑time video communication for AI assistants by integrating model‑aware bitrate adaptation, region‑focused encoding, and a degradation‑aware benchmark, achieving a 15.12% accuracy gain and a 135.31 ms latency reduction in realistic mobile uplink scenarios while incurring modest cost overhead.
AI video communicationadaptive bitratebenchmark
0 likes · 11 min read

The paper introduces TaYS (Think‑as‑You‑See), a streaming chain‑of‑thought framework that replaces the traditional “watch‑then‑think” video inference pipeline with a parallel, real‑time “watch‑and‑think” approach, dramatically reducing latency and improving accuracy on complex video reasoning tasks.
Dual KV-CacheTaYSVision-Language Models
0 likes · 8 min read

This article breaks down the latency challenges of combining AI with WebRTC, compares edge and cloud processing architectures, and provides a detailed Go‑based implementation—including RTP interception, AI model integration, real‑time translation pipelines, and performance optimizations—for ultra‑responsive video conferencing.
AIEdge ComputingGo
0 likes · 7 min read

The MIDAS framework introduced by the Kling Team combines autoregressive video generation with a lightweight diffusion denoising head to deliver real‑time, high‑quality digital‑human synthesis under multimodal control, achieving sub‑500 ms latency, 64× compression, and robust performance across multilingual dialogue, singing, and interactive world modeling tasks.
AIDigital HumanMultimodal Generation
0 likes · 6 min read

Live streaming faces challenges due to real‑time video transmission and heavy computation, but by using globally distributed edge servers, transcoding streams into multiple resolutions, segmenting them into short clips, packaging them into formats like HLS, caching via CDNs, and optionally storing them in the cloud, the process delivers video seamlessly to viewers and enables replay.
CDNHLScloud storage
0 likes · 2 min read

Alibaba’s Taobao Live team replaced rule‑based bandwidth estimators with three machine‑learning solutions—Concerto, OnRL, and Loki—trained on over a million hours of global live‑stream data, achieving up to 13% throughput gain, threefold stall reduction, and up to 44% lower 95th‑percentile stalls, now deployed commercially.
adaptive bitratebandwidth predictionmachine learning
0 likes · 14 min read

To meet 5G remote‑control demands of sub‑200 ms latency, sub‑0.2 % jitter and 20‑30 % loss, the article proposes jointly optimizing capture, transport, a reduced jitter buffer, a hybrid GCC‑plus‑SNR congestion‑control algorithm, and adaptive interleaved FEC to approach the 100 ms target.
5Gaudio-video streamingcongestion control
0 likes · 11 min read

This article details Kuaishou Y‑tech’s Gorgeous beauty platform, covering traditional smoothing, advanced skin‑tone effects, AI‑driven blemish removal, clarity enhancement, local facial tuning, and the UNet‑based GorgeousGAN that delivers one‑click high‑definition beauty for live‑stream and short‑video applications.
AI BeautyComputer Visiondeep learning
0 likes · 13 min read

AI-driven super-resolution, once limited to academic research, is now tackling real-time video communication challenges by evolving from early interpolation methods to deep learning models, addressing issues of model size, generalization, and real-world degradation, while lightweight networks and encoding-aware techniques promise practical deployment.
AIimage enhancementreal-time video
0 likes · 12 min read

Jason Mayes, a Google web engineer, open‑sourced a TensorFlow.js demo that removes people from live webcam video in real time using a lightweight MobileNet model, with only about 200 lines of code, and provides GitHub and CodePen links for experimentation.
Computer VisionMobileNetTensorFlow.js
0 likes · 9 min read

This article explains how to build a browser‑based AI video interaction system by comparing two approaches—streaming RTSP video via a JSMpeg‑powered WebSocket relay and capturing local media directly with WebRTC’s getUserMedia API—along with code samples, constraints handling, and frame‑extraction techniques.
JSMpegMediaDevicesWebRTC
0 likes · 15 min read

This article explores Ant Financial's real-time video call platform, detailing its technical choices, system architecture, signaling reliability design, network optimization strategies, and future directions for multi‑party video conferencing and interactive live streaming.
Ant FinancialSignal ReliabilityWebRTC
0 likes · 19 min read

To add multi‑person video calling with in‑call text chat on Android, developers register a Tencent Cloud account, obtain an APPID, purchase a low‑cost minute package, import the IMSDK/AVSDK/ILiveSDK/BeautySDK, generate a userSig, initialize and log in the SDK, create or join a room, bind an AVRootView for video rendering, and enable IM messaging, resulting in a functional solution built within a day.
Android SDKTencent Cloudinstant messaging
0 likes · 8 min read

This guide walks you through extending a deep‑learning object detection project to process live video streams using OpenCV, Python, and the VideoStream class, covering environment setup, command‑line arguments, model loading, frame‑by‑frame detection, FPS measurement, and performance‑boosting tips.
Object DetectionOpenCVPython
0 likes · 9 min read

This article analyzes how Alibaba built a highly scalable, low‑latency mobile live‑streaming platform for the 2016 Double 11 event, covering user growth, system architecture, latency reduction, bandwidth savings, interactive features, and the technical challenges and solutions behind the success.
Cloud Architectureinteractive featureslive streaming
0 likes · 16 min read

This article details the architecture, encoding choices, network‑level optimizations, transmission model, measurement methods, and practical pitfalls involved in building a 1080p real‑time video streaming solution that consistently keeps end‑to‑end latency below 500 ms for interactive online education.
H.264Streaming ArchitectureUDP
0 likes · 27 min read
