Tagged articles
multimedia
50 articles · Page 1 of 1
FFmpeg 9.0, codenamed “Lei,” was released on August 4 to commemorate Chinese audio‑video developer Lei Xiaohua, whose contributions to the library and early AI‑related tutorials shaped the ecosystem, while the article also traces FFmpeg’s history, naming conventions, and expanding role in modern AI pipelines.
AI pipelinesFFmpegLei Xiaohua
0 likes · 11 min read

FFmpeg 9.0, codenamed “Lei” to honor Chinese audio‑video developer Lei Xiaohua on the tenth anniversary of his death, continues the project’s evolution from a simple codec suite to a ubiquitous multimedia backbone powering video editing, streaming, and AI pipelines, while tracing its rich history and community contributions.
AI pipelinesFFmpegONNX Runtime
0 likes · 11 min read

The article analyzes the limitations of RTOS—such as weak file‑system support, constrained networking, and lack of process isolation—and explains why complex UI, multimedia, AI, and multi‑process requirements force developers to adopt embedded Linux, often in a hybrid architecture.
AIEmbedded LinuxRTOS
0 likes · 7 min read

FFmpeg, the open‑source multimedia framework that underlies YouTube, Netflix, TikTok and countless video apps, was created by a handful of brilliant but under‑paid developers whose relentless reverse‑engineering, performance‑focused design and community battles have made it the invisible backbone of modern digital media.
FFmpegcodeccommunity
0 likes · 12 min read

FFmpeg, the hidden engine behind every video you watch, was built by a handful of passionate developers who split container and codec layers, reverse‑engineered closed formats, and endured poverty and community conflict, yet their relentless optimization made it the dominant, open‑source multimedia framework worldwide.
FFmpegmultimediaopen-source
0 likes · 14 min read

This article details the construction of a high-performance demuxing pipeline for a HarmonyOS VR player using OH_AVSource and OH_AVDemuxer, covering track selection, sample reading with ReadSampleBuffer, DRM handling, seek optimization, and multi-threaded pre-reading for 4K/8K playback.
AVDemuxerDRMHarmonyOS
0 likes · 10 min read


AntTechApr 14, 2026 · Artificial Intelligence
The AT‑ADD competition, organized for ACM MM 2026, invites researchers to develop robust audio deepfake detection models across speech, environmental sounds, singing, and music, providing diverse real‑world datasets, baseline code, clear evaluation metrics, and a two‑stage submission process to advance AI security.
AT-ADDAudio DeepfakeSecurity
0 likes · 10 min read

This article recounts how India’s rise in software outsourcing inspired China, highlights two Indian inventions—USB and the Discrete Cosine Transform (DCT)—and explains how DCT’s breakthrough image compression paved the way for JPEG, MP3, and modern multimedia streaming.
DCTJPEGalgorithm history
0 likes · 9 min read

H.266/VVC, the next‑generation video coding standard finalized in 2020, delivers roughly 50 % bitrate savings over H.265/HEVC with modestly higher decoding complexity, introduces advanced intra‑ and inter‑prediction, transform, quantization, entropy and loop‑filtering tools, and faces patent‑pool and adoption challenges before widespread smartphone integration around 2026.
CompressionH.266VVC
0 likes · 20 min read

At the China Multimedia 2024 conference in Yinchuan, Kuaishou presented its latest AI‑driven large‑model technologies—including text‑to‑image, text‑to‑video, and audio models—alongside advances in intelligent video coding, a new research‑fund initiative, and recent industry awards.
AIKuaishoularge models
0 likes · 5 min read

Bilibili’s Multimedia Lab created an end‑to‑end intelligent restoration system that assesses video resolution, frame‑rate and quality, then automatically selects and applies image‑level enhancement, frame‑rate up‑sampling, background and face restoration, and optical‑flow interpolation to transform blurry, jittery, artifact‑laden legacy videos into clear, smooth, high‑quality streams, now deployed for on‑demand content and slated for live‑stream expansion.
AIframe interpolationimage enhancement
0 likes · 12 min read

FFmpeg provides a comprehensive, cross‑platform hardware acceleration framework that abstracts diverse GPU and dedicated video codec interfaces, defines HWContext types, device and frame contexts, and various codec configuration methods, enabling efficient video encoding, decoding, and filtering while addressing performance, compatibility, and pipeline complexity challenges.
FFmpegGPUhardware acceleration
0 likes · 10 min read

The article curates standout AI papers from 2023 CCF‑A conferences—including CVPR, ICLR, ACM MM, and INFORMS—showcasing advances such as Swin‑Transformer video quality assessment, cross‑modal e‑commerce product search, transformer‑based vehicle routing heuristics, diffusion‑driven dance generation, and reinforcement‑learning inventory replenishment.
AIComputer Visionmultimedia
0 likes · 23 min read

The Haro Street Cat mobile team created a custom multimedia framework that wraps FFmpeg 4.2.2 in a C++ core library with Android/iOS compatibility layers and Java wrappers for transcoding, live streaming, and composition, delivering hardware‑accelerated decoding, flexible filter pipelines, and reliable transcoding that boosted coverage to over 99 %, cut storage by more than 30 %, accelerated video start‑up, and improved streaming and watermarking performance.
C++FFmpegFilter Graph
0 likes · 27 min read

Bilibili’s AI‑driven frame‑interpolation pipeline upgrades low‑frame-rate videos to smooth high‑frame-rate 1080p playback by optimizing optical‑flow models for large motion, texture and text artifacts, pruning for speed, and deploying via the BVT SDK across on‑demand and live streams.
AIVideo Frame Interpolationdeep learning
0 likes · 14 min read

This article introduces Python's multimedia service modules, explaining how to process raw audio data, read and write various audio file formats, detect image and sound file types, convert color systems, and access OSS‑compatible audio devices, all illustrated with practical code examples.
audiofile handlingmultimedia
0 likes · 7 min read

This article presents Weibo's comprehensive multimedia content understanding pipeline, covering video summarization techniques, quality assessment models, OCR advancements, video embedding strategies, and the performance benefits of CV‑CUDA acceleration, while highlighting real‑world applications and engineering trade‑offs.
CV-CUDAComputer VisionEmbedding
0 likes · 32 min read

Alibaba’s Taobao VQA team won the CVPR NTIRE 2023 Video Enhancement Challenge by introducing MD‑VQA, a multi‑dimensional no‑reference video quality model that combines a Swin‑Transformer‑V2 spatial backbone, a pre‑trained SlowFast motion encoder, and a convolutional fusion module, pre‑trained on LSVQ, fine‑tuned on NTIRE data, and augmented spatio‑temporally, achieving state‑of‑the‑art SROCC and PLCC scores and now powering quality monitoring on Alibaba’s live‑streaming and short‑video services.
No-ReferenceSwin Transformermultimedia
0 likes · 15 min read

The article defines pipeline domain design concepts, compares major multimedia frameworks such as FFmpeg, GStreamer, MediaPipe and AVPipeline, and demonstrates a configurable, extensible node‑based architecture that enables fast plugin integration and adaptable audio‑video pipelines across diverse business scenarios and platforms.
AIPipelineframework
0 likes · 39 min read

FFmpeg 6.0 “Von Neumann” has been officially released, introducing numerous new encoders, decoders, and filters, adding ABI versioning to major releases, deprecating old APIs, and enhancing CLI performance with threading, statistics options, and file‑based filter options, while outlining upcoming features for version 6.1.
DecodersEncodersFFmpeg
0 likes · 6 min read

FFmpeg 6.0 "Von Neumann" introduces a host of new codecs, decoders, filters, CLI enhancements, ABI versioning, and a more frequent release cadence, offering developers expanded multimedia processing capabilities and improved performance across platforms.
FFmpegSoftware Releasebackend development
0 likes · 6 min read

FFmpeg 6.0 "Von Neumann" introduces a host of new decoders, encoders, filters, hardware‑accelerated AV1 support, ABI versioning, and numerous performance and API improvements, marking a major, more structured release cycle for the multimedia framework.
AV1FFmpegFilters
0 likes · 5 min read

The article provides a comprehensive overview of digital watermarking, covering its fundamental concepts, security features, embedding/detection/extraction processes, major algorithm families, practical applications such as copyright protection and anti‑counterfeiting, and future research directions in multimedia information security.
Signal Processingcryptographymultimedia
0 likes · 20 min read

This article explains how Tencent's advertising system leverages multimedia AI techniques—including multi‑armed bandit, pairwise learning, and DeepFM models—to automatically select optimal templates, music, and stickers for image and video assets, thereby reducing production cost, improving creative quality, and boosting ad performance.
MABadvertising AIdeepfm
0 likes · 17 min read

This article explains how to use Three.js to create a realistic 3D phone product page by loading and applying multimedia assets such as custom fonts, textures, audio sources, and video textures, and demonstrates interactive features like ray‑casting for material switching and first‑person controls.
3DJavaScriptThree.js
0 likes · 19 min read

This article explains the OpenMAX (OMX) multimedia acceleration standard, its three-layer architecture (Application, Integration, Development), how it’s used in frameworks like gStreamer, StageFright, and the AVProcessEngine plugin library to modularize audio, video, and image algorithms across Android, iOS, macOS, and Windows platforms.
AVProcessEngineOpenMAXPlugin Architecture
0 likes · 16 min read

The article introduces DeViT, a novel Deformed Vision Transformer framework for video inpainting that leverages a deformable patch homography estimator, mask‑pruned attention, and spatio‑temporal weight adaptation, achieving state‑of‑the‑art results on benchmark datasets and highlighting its potential for advanced video editing tools.
DeViTTransformermultimedia
0 likes · 10 min read

Researchers from Kuaishou and Xi’an University of Electronic Science and Technology presented a novel deep‑learning‑based SDR‑to‑HDR video conversion method at ACM Multimedia 2022, introducing hierarchical dynamic context feature mapping, a layered dynamic feature modulation module, and a patch‑discriminator GAN that together achieve superior objective and subjective HDR quality.
HDR videomultimediavideo conversion
0 likes · 6 min read

At ACM MM 2022, Youku Moku Lab chaired the pioneering QoEVMA workshop, receiving 14 international submissions and accepting eight papers that advanced Quality of Experience assessment for diverse visual multimedia formats, while showcasing the lab’s free‑viewpoint video technology deployed in major events such as the 2022 Beijing Winter Olympics.
ACM MMFree‑viewpoint videoKPI
0 likes · 5 min read

The article walks through ffplay’s end‑to‑end playback pipeline—starting with protocol and container demuxing, initializing FFmpeg and SDL, spawning read and decoder threads, handling video/audio decoding, synchronizing streams, and finally rendering frames—offering design insights for constructing a basic media player.
FFmpegSDLaudio-video sync
0 likes · 18 min read

Bilibili’s WasmPlayer is a WebAssembly‑based HEVC software decoder that runs entirely in C/C++, handling demuxing, decoding, resampling and A/V sync on worker threads, using SIMD, AudioWorklet and OffscreenCanvas to deliver smooth 4K 60 fps web video playback with reduced bandwidth and CPU load.
AudioWorkletHEVCSIMD
0 likes · 13 min read

MoviePy is an open‑source Python library licensed under MIT that enables cross‑platform video editing tasks such as cutting, concatenating, adding titles, compositing, and processing audio‑video files—including GIFs—through a simple API demonstrated with a complete code example.
Pythonmoviepymultimedia
0 likes · 2 min read

This article presents Tencent's advertising multimedia AI platform, detailing its intelligent video creation engine, fine‑grained ad content understanding, large‑scale similar‑ad retrieval system, and automated ad review pipeline, while also introducing the team and current recruitment opportunities.
Content moderationad understandingadvertising AI
0 likes · 22 min read

This comprehensive guide introduces multimedia front‑end development, explains W3C media standards and HTML elements, explores media APIs, outlines playback scenarios and solutions, and details both consumer‑facing live video systems and production‑side tools such as streaming and video‑editing, while sharing Alibaba’s roadmap for the field.
media APIsmultimediaplayback
0 likes · 25 min read

Celebrating two decades of the open‑source FFmpeg project, this article explains how its multimedia decoding libraries underpin popular video players and major platforms, recounts the 2011 split that birthed Libav, discusses licensing obligations under LGPL/GPL, and reveals the infamous “shame pillar” list of software that ignored those rules.
FFmpegmultimediaopen-source
0 likes · 6 min read

In this candid talk, a former Alibaba multimedia front‑end engineer shares his career journey—from early patents and B2B animation work to leading live‑streaming projects, detailing the challenges, technical breakthroughs, and personal reflections that helped him overcome professional uncertainty.
career developmentlive streamingmultimedia
0 likes · 13 min read

Lin Wan shares her career path from a fresh graduate at Alibaba International Station to a multimedia front‑end leader in Taobao Live, detailing personal growth, patent achievements, technical breakthroughs, and lessons on overcoming front‑end career confusion.
AlibabaCareerWeb Media
0 likes · 12 min read

This article explains how Alibaba’s multimedia front‑end team built a same‑layer rendering video player for H5, detailing the architecture, performance advantages, degradation strategies, issues encountered during the 618 promotion, and future plans to improve playback experience across live and on‑demand scenarios.
AlibabaH5multimedia
0 likes · 11 min read

AV1, the royalty‑free video codec created by the Alliance for Open Media and supported by Tencent’s Multimedia Lab, combines advanced block partitioning, intra‑ and inter‑prediction, versatile transforms, sophisticated entropy coding, and loop‑filtering to cut bitrates by roughly 20% for streaming, cloud transcoding, 8K, VR, and medical imaging, while paving the way toward future AV2 and VVC standards.
AOMediaAV1Video Standards
0 likes · 17 min read

FFmpeg 4.3 has been released, adding support for TrueHD in MP4, Intel QSV‑accelerated MJPEG and VP9 decoding, Vulkan‑based AMD AMF encoding on Linux, AV1 encoding via rav1e, ZeroMQ, VDPAU VP9 decoding, and numerous filter enhancements.
AV1FFmpegVulkan
0 likes · 2 min read

This article explores the front‑end multimedia technologies that power Taobao Live, covering video and audio fundamentals, container and codec formats, streaming protocols, player architecture, web media APIs, and popular open‑source frameworks for building robust live‑streaming experiences.
audiolive streamingmultimedia
0 likes · 16 min read

iQIYI has become the first Chinese video platform to deploy the open‑source AV1 codec on its PC web and Android apps, cutting video file size by about 20%, and its in‑house QAV1 encoder further reduces bitrate over 40% and runs roughly five times faster than competing encoders, enabling smoother 4K/8K streaming while saving bandwidth.
AV1QAV1Video Encoding
0 likes · 5 min read

This article traces the evolution of call center technology across four generations—from early hotlines using PSTN and PBX, through IVR and CTI innovations, to modern multimedia channels—highlighting key concepts, features, and their impact on operational efficiency and customer service.
CTIIVROperations
0 likes · 10 min read

The CBVRP (Content-Based Video Relevance Prediction) challenge, co‑hosted by Hulu and ACM MM 2019, showcased the shift from user‑based collaborative filtering to content‑driven recommendation, highlighted winning teams and their papers, and underscored the ongoing research importance of cold‑start video recommendation for streaming platforms.
cold startcontent-based recommendationmachine learning
0 likes · 15 min read

With 5G accelerating video traffic, immersive media relies on advanced 3D representation, efficient point‑cloud and video‑based compression, standardized containers, and selective streaming to enable realistic VR/AR experiences across gaming, autonomous driving, and broadcasting, while Tencent’s lab drives standards and future XR applications.
3D5GVR
0 likes · 12 min read


ITPUBSep 30, 2019 · Fundamentals
Discover a curated list of ten indispensable, free, open‑source Linux applications—from package managers and media players to office suites and security tools—each with key features, usage tips, and direct download links to enhance your Linux desktop experience.
LinuxSoftwaremultimedia
0 likes · 11 min read


58 TechApr 16, 2019 · Mobile Development
The article outlines the technical challenges of short‑video apps and presents the modular, extensible architecture of the 58 Short Video SDK, detailing its layered design, design principles, advantages, and future evolution to support advanced features such as AR, hardware decoding, and h265 encoding.
multimediashort videovideo processing
0 likes · 12 min read

During the CCF Multimedia Committee’s visit to iQIYI, senior researchers and professors presented cutting‑edge AI, knowledge‑graph‑driven content distribution, image‑text sentiment matching, and intelligent multimedia transmission technologies, while interactive tours of studios and labs deepened academia‑industry collaboration and highlighted iQIYI’s innovative multimedia ecosystem.
AICCFVideo Transmission
0 likes · 8 min read

This article introduces FFmpeg, outlines its eight core libraries, describes the main command‑line tools (ffmpeg, ffplay, ffprobe), and provides a step‑by‑step example of converting an MP4 video to HEVC with MP3 audio on Windows, including useful help commands and additional features.
FFmpegmultimediavideo processing
0 likes · 5 min read

Three Alibaba iDST papers on the AI‑driven City Brain were selected for ACM Multimedia 2017, showcasing novel video anomaly detection, deep siamese re‑identification, and stylized image generation methods that improve urban traffic management and demonstrate the broader potential of Alibaba’s ET Brain platform.
multimediavideo anomaly detection
0 likes · 8 min read
