This article provides a comprehensive overview of WebRTC's quality‑of‑service mechanisms—including NACK, FEC, SVC, jitter buffering, IDR requests, pacing, bandwidth estimation, probing, dynamic frame‑rate, AV sync, and resolution adaptation—detailing their principles, implementation, and impact on real‑time audio‑video communication.
This tutorial explains the advantages of WebSocket over HTTP and provides a step‑by‑step guide, including Maven dependency, Spring Boot configuration, a ServerEndpoint class, a simple HTML/JavaScript front‑end, and a controller method, to build a real‑time chat system with online/offline notifications and private or broadcast messaging.
Learn how to achieve real‑time data synchronization between separate front‑end applications by leveraging WebSocket and Socket.io, covering the protocol basics, connection setup, event handling, server implementation, alternative communication methods, and practical code examples for both client and server sides.
5G’s high bandwidth, low latency, and edge offloading empower real‑time remote control of complex equipment, demanding synchronized video, audio, and control signals, which are addressed by real‑time AV communication, control‑signal synchronization, and network optimization, while evolving system architectures—from direct‑connection models to integrated fusion designs—ensure scalability, reliability, and minimal latency for applications in mines, ports, logistics, and autonomous vehicles.
From Tencent Meeting’s 3.0 launch and new webinar mode to Microsoft’s metaverse preview, Firefox’s biggest WebRTC upgrade, Safari’s bug surge, Zoom’s auto‑captioning, and emerging standards like SVC and WebTransport, this roundup surveys the latest real‑time audio‑video technologies, product releases and industry trends shaping 2021.
This article explains the concept, components, and algorithms of WebRTC's adaptive jitter buffer, detailing how it calculates network, decode, and render delays to ensure smooth video playback while balancing latency and packet loss.
This article explains NetEQ, the adaptive audio jitter buffer and packet‑loss concealment technology used in WebRTC, detailing its architecture, core modules, jitter‑estimation algorithms, decision logic, and speed‑change processing, and shows how a custom server‑side implementation can improve stability and listening experience.
This article compares three WebRTC multiparty communication architectures—Mesh, MCU, and SFU—detailing their bandwidth requirements, advantages, disadvantages, and recommending the most suitable option based on participant count and network conditions.
This article explores the evolution of AI audio algorithms in real‑time communication, detailing current trends, technical hurdles such as computational complexity and data scarcity, and practical solutions including lightweight models, data augmentation, and hybrid AI‑traditional pipelines, illustrated with real‑world NetEase Cloud IM case studies.
The DAP system, developed by Kuaishou’s audio‑video network transmission team, won the ACM MM 2021 Grand Challenge by introducing deadline‑aware scheduling and a novel paired‑sending congestion control algorithm that dramatically improves QoE for real‑time video streams, outperforming Copa, BBR and DRL by up to 43.5%.
This article details a comprehensive redesign of acoustic echo cancellation, automatic gain control, and automatic noise control for real‑time communication, combining WebRTC and Speex to improve delay estimation, linear filtering, and non‑linear processing, and demonstrates superior performance over the original WebRTC solution.
This article explains WebRTC fundamentals, compares it with WebSocket, describes SDP, ICE, STUN/TURN NAT traversal, and provides full server‑side and client‑side JavaScript code to build a peer‑to‑peer video conferencing demo.
This article traces the 25‑year evolution of real‑time communication (RTC) across five generations—from the early MCU era to P2P, SFU, cloud‑SFU, and the current global cloud RTC stage—highlighting key protocols, architectural shifts, advantages, drawbacks, and emerging AI‑driven media processing techniques.
This article explains how to create a browser‑based 1‑to‑1 real‑time audio/video communication application using WebRTC APIs, covering media capture, SDP and ICE handling, signaling with socket.io, peer‑to‑peer connection setup, data channels, and NAT traversal techniques.
The Xianyu instant‑messaging system evolved from a 2014 MVP to a robust, multi‑version architecture—adding distributed storage, hybrid sync, ACK‑based delivery, and feature‑driven monitoring—to handle billions of messages, improve stability, and boost user satisfaction, cutting technical complaints by half.
This talk explains the evolution and practical implementation of large‑scale real‑time audio‑video communication, covering common architectures such as direct P2P, MCU, and SFU, network topologies, scalability, high‑availability techniques, edge computing, and emerging technologies like WebRTC, SDN, and AI‑driven enhancements.
This guide explains how WebSockets enable full‑duplex communication over a single TCP connection, compares popular Go WebSocket libraries, and provides complete client‑server code examples for TCP, UDP, and HTTP‑based WebSocket implementations, helping developers build real‑time applications such as chat, games, and monitoring tools.
The article explains why traditional polling methods fall short for real‑time data, introduces the WebSocket protocol’s full‑duplex handshake and heartbeat mechanisms, and demonstrates how a Java‑based WebSocket service efficiently streams audio to an ASR engine for low‑latency speech recognition.
This article explains the demand for fun voice‑changing effects in live streaming and voice chat, introduces common audio effects such as Tremolo, Flanging, and Distortion, and details several real‑time pitch‑preserving algorithms—including OLA, WSOLA, PSOLA, and Phase‑Vocoder—used by NetEase Cloud Communication to deliver high‑quality, privacy‑preserving voice transformations.
This article introduces WebSocket, explains why it is preferred over HTTP for real‑time communication, and provides a complete Spring Boot integration tutorial with Maven dependencies, configuration, server endpoint code, controller, and a simple HTML client, all illustrated with runnable examples.
This article details NetEase Cloud's backend engineering solutions for supporting ten‑thousand‑user concurrent mic connections, covering distributed signaling architecture, QUIC‑based weak‑network handling, server‑side audio routing, video QoS strategies, and a global transmission network (WE‑CAN) to achieve high availability and scalability.
Volcano Engine RTC shares its best‑practice solutions for large‑scale interactive scenarios—including thousand‑person audio chat, live‑stream co‑hosting, and cloud rendering—detailing server‑side stream selection, intelligent mixing, and edge‑node integration to reduce latency, bandwidth, and computational load while enhancing user experience.
This article explains how NetEase Cloud’s NERTC Video Quality Controller (VQC) monitors network QoS, video processing algorithms, and its own metrics to dynamically balance clarity, smoothness, and delay, detailing each sub‑module, decision model, and practical QA from a live session.
The ByteDance Volcengine meetup showcased four expert talks covering RTC scalability for interactive entertainment, zero‑latency VOD optimization, cutting‑edge H.266 video codec development, and reliable live‑stream event practices, offering deep technical insights into powering billion‑user short‑video services.
This article explores the architectural design and signaling mechanisms behind a real-time audio/video tutoring service built for smart desk lamps, detailing the three-layer RTC middleware, classroom abstraction, interactive signaling workflows, and scalable extensions from one-on-one sessions to large virtual classrooms.
WE‑CAN, NetEase Cloud Communication's self‑developed large‑scale distributed transmission network, dramatically improves end‑to‑end data quality, reduces costs, and supports diverse real‑time communication scenarios through intelligent routing, layered decoupling, and global edge deployment, as demonstrated by extensive production metrics.
This article walks through building a real‑time push system with Spring Boot by integrating WebSocket and MQTT, covering the protocol basics, Maven setup, configuration classes, server implementation, controller endpoints, front‑end testing page, common pitfalls, and deployment tips.
This tutorial demonstrates how to integrate Spring Boot with WebSocket to achieve server‑initiated real‑time message pushing, covering dependency setup, configuration, server implementation, controller and client page code, and troubleshooting initialization order issues.
This article explains the fundamentals of RTC, distinguishes it from traditional streaming, highlights WebRTC's cross‑platform, plugin‑free benefits, and shows how low‑latency real‑time communication can enhance interactive applications.
This article explains the concept and role of signaling in real‑time audio/video, describes the single‑PeerConnection architecture using WebSocket, details the handshake, keep‑alive and reconnection mechanisms, and outlines NERTC’s modular network library design for robust communication under weak network conditions.
The announcement that WebRTC 1.0 is now an official W3C/IETF standard highlights its role as a free, browser‑based JavaScript API that enables secure, plugin‑free audio‑video communication across devices, transforming education, healthcare, entertainment, and enterprise collaboration worldwide.
This guide explains how to use WebSocket in a WeChat Mini‑Program to implement real‑time features such as live‑room comments, user join/leave events, likes, follows, and product shelf updates, covering protocol basics, handshake details, API usage, example code, heartbeat monitoring, and automatic reconnection strategies.
This article walks through using Socket.IO to test whiteboard pixel data transmission, presenting a Java test script, sample console logs, and an explanation of the joinRoom interface that pushes full board state to connected clients.
Tencent's Real‑Time Audio‑Video (TRTC) platform delivers sub‑second, cross‑platform RTC for up to 300 participants and 100 000 viewers, using UDP‑based NACK/FEC, dynamic QoS, AI‑enhanced video/audio effects, and cloud‑driven QoE optimization to support diverse scenarios such as online meetings, education, live streaming, and industry‑specific applications.
This article details the evolution of the voice endpoint detection (VAD) module in 58.com’s voice robot, comparing a dual‑threshold method, Google’s WebRTC VAD, and the deep‑learning based VADNet, and presents experimental results on accuracy, recall, F1 score and online latency.
This article explains how NetEase CloudSign leveraged WebRTC to engineer a real-time audio‑video engine from scratch, detailing the engineering workflow, SDP signaling, and four key optimizations such as Simulcast, hardware codec support, audio profiling, and transmission strategy adjustments.
This practical guide explains WebSocket fundamentals, demonstrates how to integrate and debug them in a project with webpack proxy and Nginx settings, implements heartbeat and reconnection logic for stability, and compares native WebSocket to Socket.io’s richer but heavier real‑time framework.
The LiveVideoStackCon 2020 conference highlighted AI's growing role in audio processing, detailing Dr. Hao Yiya's modular AI approach, current challenges like computational load and robustness, and NetEase Cloud's data‑driven advancements that are reshaping real‑time communication audio.
The article outlines XdfRTC's high‑concurrency, global coverage, low‑latency, elastic scaling and multi‑platform support features, then details the evolution of RTC media forwarding architectures—including MESH, MCU, SFU, mesh‑based, and hierarchical designs—highlighting their schemes, advantages, and drawbacks.
This tutorial explains how to use the Workerman PHP socket framework and GatewayWorker to replace HTTP long‑polling with WebSocket‑based real‑time communication, covering protocol basics, short vs. long connections, integration with MVC frameworks, and complete client‑ and server‑side code examples.
WebRTC is a Google‑originated technology that enables real‑time audio, video, and data transmission across browsers, mobile platforms, and IoT devices, and this article explains its popularity, P2P connection process, signaling, NAT/ICE mechanisms, STUN/TURN servers, VP9 codec, JavaScript APIs, and security measures.
This article explains the origins, definition, basic frame format, masking purpose, and handshake process of the WebSocket protocol, and demonstrates packet capture analysis with a simple demo to illustrate how full‑duplex communication works over a single TCP connection.
This article explains the principles and practical implementation of WebSocket, compares it with HTTP, discusses when to use it, and details a complete backend and frontend solution using Spring WebSocket, SockJS, and STOMP for real‑time communication in web applications.
This article explains how WebRTC builds the video processing pipeline by detailing the capture module, internal data flow, VideoTrack construction, rendering, and encoder integration, and it outlines the key API calls such as AddTrack, CreateOffer, and SetLocalDescription that establish the end‑to‑end video stream.
This article explains WebRTC fundamentals, key APIs, and demonstrates how to build a browser‑based peer‑to‑peer video chat by implementing a lightweight signaling server in PHP using Swoole coroutines, complete with client‑side JavaScript code, server logic, and deployment tips.
Tencent Cloud Video’s platform, now powering WeChat, Tencent Meeting and Education, tackles pandemic‑driven traffic spikes with multi‑regional data centers, 1,300+ CDN nodes, sub‑300 ms latency, AI‑driven smart encoding, support for AV1/AVS2 codecs and SRT transport, while expanding fast‑live, cloud editing and AI content analysis for future immersive, AI‑generated experiences.
Within a week, the 'Fight Epidemic' quiz mini‑game grew 60‑fold in users, leveraging Tencent Cloud’s MGOBE matchmaking engine, CloudBase serverless backend, and AME music service to deliver real‑time multiplayer, data storage, and licensed audio, illustrating rapid, scalable game development during a health crisis.
Youku’s low‑latency live‑streaming system replaces the traditional RTMP‑CDN pipeline with a controllable media‑transport architecture that combines private real‑time protocols, WebRTC, and edge nodes, cutting anchor‑to‑anchor latency below 300 ms and anchor‑to‑viewer latency to under 415 ms while preserving smooth playback.
The article describes a server‑driven, H5‑based dynamic layout architecture for Huajiao's multi‑party voice chat, detailing its design principles, benefits such as reduced client development, flexible layout switching, and the interaction mechanisms among server, H5 front‑end, and client.
This article explains the limitations of short and long polling, introduces the WebSocket protocol and its handshake mechanism, and provides complete client‑side and Node.js server code to build a basic real‑time chat application with heartbeat keep‑alive support.
The 58 Group technical salon presented detailed practices on Tencent Cloud video services, real‑time audio/video communication, and mobile live‑streaming SDK implementation, covering architecture, protocols, encoding, troubleshooting, and future directions for improving streaming quality and user experience.
This article provides an in‑depth technical analysis of integrating real‑time audio/video (RTC) with legacy PSTN, covering latency sources, protocol and codec differences, adaptation layers, system architecture, and optimization techniques such as jitter buffering, ARQ/FEC, and automatic failover.
On June 29, Tencent Cloud’s Audio/Video and Integrated Communication Technology Salon in Beijing gathered over 300 attendees and live‑streamed five expert sessions that tackled mobile live‑stream interconnection, P2P acceleration, overseas streaming architecture, real‑time audio/video‑PSTN integration, and AI‑enhanced video solutions, before ending with a raffle and announcing a July 27 IoT follow‑up.
This article explains how to use ThinkJS, a Koa‑based Node.js framework, together with WebSocket and Socket.io to build a multi‑device real‑time chat system, covering protocol basics, server and client configuration, a simple chat demo, and scaling across multiple nodes using Redis.
This article introduces WebRTC, the browser‑based real‑time communication technology backed by Google, Mozilla and Opera, explains its rapid adoption statistics, core features, security mechanisms, and explores future possibilities in IoT and everyday devices.
This article describes a comprehensive solution for enabling real‑time audio and video communication between existing WebRTC endpoints and WeChat Mini Programs by introducing a WebRTC Gateway and Streaming Server, detailing architecture, signaling flows, media conversion, performance optimizations, and session reliability mechanisms.
Tencent Video Cloud, a PaaS offering embedded in WeChat mini‑programs, delivers low‑latency live streaming, on‑demand video and multi‑party video calls via custom live‑pusher and live‑player tags, enabling enterprise scenarios such as insurance claims, virtual showrooms, tele‑medicine, and remote court hearings while meeting compliance requirements.
This article examines the rapid evolution of the audio‑video industry, outlines the cloud‑endpoint‑service model, and dives into video encoding standards, adaptive bitrate strategies, quality metrics, and real‑time server architectures such as MCU and SFU to meet global communication demands.
This article describes the background, architecture, signaling flow, client and server components, and code details of TEG's WRTC solution for real‑time audio/video calls and IP‑telephony, including WebRTC fundamentals, SIP integration, and DTMF support.
The talk outlines Taobao Live’s rapid growth and three‑layer interactive architecture—dynamic AI‑driven marketing tools, human‑computer interaction features such as facial and gesture recognition, and intelligent operations that score fan intimacy—to deliver low‑latency, AI‑enhanced streaming with innovations like virtual backgrounds, product recognition, and an automated live‑assistant.
This article explains WebRTC—its definition, features, advantages, drawbacks, architecture diagrams, core APIs, demo code analysis, browser compatibility, and how to build a simple Node.js signaling server for peer‑to‑peer audio, video, and data communication.
The guide details how to implement Tencent Cloud’s live‑streaming PK feature, enabling two streamers to video‑call each other while audiences view both feeds side‑by‑side, using a cloud‑based mixing solution with separate low‑latency and CDN channels to ensure seamless, buffer‑free transitions and scalable performance.
This article explains the WebSocket protocol, compares it with traditional Ajax polling, shows client‑side JavaScript and server‑side Python implementations, details the handshake, frame parsing, and message framing, and highlights its suitability for real‑time applications.
The article analyzes the rise of audio and video capabilities in mini‑programs, explains their technical implementation via Tencent Cloud SDKs, and explores real‑world industry scenarios—from education and gaming to insurance claims and judicial services—highlighting benefits, challenges, and practical solutions.
The April 21 Tencent Cloud+ community salon in Beijing gathered over 200 developers to explore audio‑video industry trends, showcase Tencent Video Cloud's product panorama, discuss H5 real‑time communication QoE optimizations, address material legality, and dissect mini‑program audio‑video scenarios and implementations across various sectors.
This technical article discusses implementing an automatic printing solution for e-commerce merchants using WebSocket and Netty frameworks to enable real-time order push notifications and reduce manual intervention in the order processing workflow.
This article provides a comprehensive guide to WebSocket, covering its purpose, connection establishment, handshake process, data frame structure, masking algorithm, security considerations, and includes practical Node.js server and client code examples to illustrate real‑time bidirectional communication.
This article explains what IRC is and outlines eight technical advantages—distributed architecture, low bandwidth, privacy, cross‑platform support, and a rich bot ecosystem—plus additional cultural reasons why many open‑source developers continue to favor this decades‑old chat protocol.
This article reviews the main web push techniques—short polling, long polling, iframe streaming, WebSocket, and Server‑Sent Events—explaining their principles, advantages, disadvantages, and suitability, and presents a practical implementation case with a detailed comparison and troubleshooting guide.
This article compares common web push techniques—including short polling, long polling, iframe streaming, WebSocket, and Server‑Sent Events—examining their principles, advantages, and drawbacks, and presents a practical selection and implementation case for real‑time order notifications in a client‑server application.
This article explains the background, protocol basics, handshake process, and practical implementation of WebSocket using Netty and netty‑socketio on the server side and socket.io on the client side, providing full code examples and deployment tips for high‑concurrency real‑time applications.
This article introduces the fundamentals of web live streaming, compares common transport protocols, explains WebRTC architecture and core APIs, and highlights practical challenges and a forthcoming conference talk on applying WebRTC to low‑latency streaming scenarios.
This article explains WebRTC fundamentals, including its core JavaScript APIs, device compatibility, the STUN/TURN/ICE process for establishing peer-to-peer connections, SDP negotiation, and provides a complete code example for building a simple browser‑based video chat application.
This article provides a comprehensive overview of WebSocket, covering its origins as a full‑duplex HTML5 protocol, core JavaScript API usage, sub‑protocol negotiation, framing rules, security considerations, performance comparisons with XHR and SSE, deployment challenges, and related extensions such as Socket.IO.
This article explains WebSocket fundamentals, the HTTP‑based handshake process, client‑side JavaScript API usage with code examples, and a complete Node.js server implementation including connection handling, data‑frame parsing, message broadcasting, heartbeat maintenance, and browser compatibility considerations.
This article introduces Socket.IO, explains its features and transport fallback mechanisms, showcases a real‑world example (tty.js Linux terminal), and provides a step‑by‑step guide to create a simple web page that displays the server’s current time using Node.js and client‑side JavaScript.
This article surveys popular WebSocket and real‑time communication libraries across languages, highlighting their core features such as heartbeat, reconnection, fallback mechanisms, publish‑subscribe patterns, and data‑sync capabilities, while providing direct links for quick reference.
SockJS provides a mature, cross‑browser real‑time communication library that mimics WebSocket while offering fallback transports, load‑balancing options, and easy client‑server integration, making it ideal for building robust web applications in complex network environments.
This article explains the fundamentals of instant messaging, its system characteristics, protocol layers (application, security, transport), practical protocol examples, and a detailed real‑time web chatroom design using HTTP long‑polling and backend architecture considerations.
This article explains the origins and standards of WebSocket, compares its full‑duplex communication model with traditional HTTP, details server‑side and client‑side APIs with Java and JavaScript code examples, and presents a practical case study of real‑time device tracking using Tomcat.
The article details Zoosk's real-time communication system, describing member presence, notifications, instant messaging, the XMPP‑based Tigase server cluster, BOSH support, monitoring scripts, performance metrics, business intelligence reporting, and future plans to extend RTC to mobile web applications.
