This article explains the fundamentals of audio‑video concepts and demonstrates how to use Android's MediaCodec, EGL, MediaMuxer and iOS's AVAssetWriter, GPUImage, and related native APIs to render OpenGL transition effects on images and combine them with audio into a final video file.
The article evaluates software versus hardware video decoding for Baidu’s Android app, presents benchmark data showing surface‑mode hardware decoding’s superior efficiency, identifies compatibility and first‑frame latency challenges, and proposes a monitoring module plus seamless soft‑to‑hard decoder switching to achieve high hardware‑decode usage while maintaining fast startup and low error rates.
This article explains Android’s Video Device Manager (VDM) within WebRTC, covering the graphics system, Surface/BufferQueue model, capture, encoding, rendering pipelines, cross‑platform implementation layers, and compatibility optimizations, providing developers with a comprehensive view of Android video handling in real‑time communication.
This article analyzes the trade‑offs between software and hardware video decoding on Android, presents performance measurements for different MediaCodec modes, identifies compatibility and latency challenges, and proposes a decoder‑monitoring system and seamless switch architecture to maximize playback efficiency.
This article analyzes the latency of video publishing in a mobile app, proposes a parallel video‑track transcoding solution, details implementation steps, performance testing, and optimization techniques to reduce encoding time by up to 30% on Android devices.
This article explains the technical challenges of high‑latency video decoding in Android game streaming with Moonlight, analyzes why it occurs, and provides practical solutions—including API choices, immediate buffer release, frame ordering, and low‑latency vendor configurations—to achieve smoother, low‑delay gameplay.
This article explains how to convert a series of images into a video on Android, compares two processing pipelines, and details the implementation of custom OpenGL transition effects—including slide, pixelation, ripple, and random‑grid—using MediaCodec and shader programs.
This article details Meituan's end‑to‑end development of a merchant‑side mobile video feature, covering background needs, architecture design, technology selection, implementation of playback, recording, composition, cutting, processing pipelines, encountered pitfalls, monitoring strategies, and future optimization directions.
This article explains the fundamentals of Android MediaCodec, its advantages over software codecs, usage patterns, supported MIME types, practical implementations for video editing and live streaming, and presents a performance comparison showing lower CPU and memory consumption.
The article explains why video encoding is essential for compression and compatibility, describes the video data processing pipeline, compares four encoding schemes (ffmpeg+x264, openh264, MediaRecorder, MediaCodec) offered by a short‑video SDK, and recommends suitable solutions for various recording and streaming scenarios.
This guide explains how to decode a video, render a watermark with OpenGL, re‑encode the frames, and mux them into a new file on Android, covering texture types, viewport positioning, blending, and the required MediaCodec and MediaMuxer code.
This tutorial explains how to use Android's MediaCodec to encode video frames—either via byte arrays or an input Surface—and then combine the encoded video with audio using MediaMuxer to produce a synchronized MP4 file, complete with code samples and step‑by‑step guidance.
This guide explains how to convert video stream data into individual bitmap images on Android by using SurfaceTexture to receive decoded frames, OpenGL to render them as external textures, and glReadPixels to capture the RGBA data for saving as PNG files.
This guide walks through using Android's MediaCodec with a TextureView to extract, decode, and render video frames, covering setup of TextureView, MediaExtractor, handling input and output buffers, synchronizing playback with PTS/DTS, and adding audio playback via AudioTrack and Sonic library.
This tutorial walks through the complete Android MediaCodec workflow, covering creation, configuration, synchronous and asynchronous data handling, buffer management, and proper end‑of‑stream signaling for both encoding and decoding scenarios.
This article explores Android’s MediaCodec API, detailing its role in hardware video encoding/decoding, buffer management, data types, lifecycle states, and practical code examples, providing developers with a comprehensive guide to implementing advanced video processing features such as watermarking and transcoding on mobile devices.
This article examines Android video recording challenges, compares hardware (MediaCodec) and software (FFmpeg + x264/openh264) encoders, highlights device‑specific pitfalls such as color‑format support and alignment, and presents fast NEON‑based algorithms for scaling, rotation, and mirroring of YUV frames.
This article examines Android video encoding challenges, compares hardware (MediaCodec) and software (FFmpeg+x264/openh264) codecs, and presents fast YUV frame preprocessing techniques—including scaling, rotation, and mirroring—using NEON optimizations to achieve high‑quality, low‑latency recordings.
