Tagged articles
video understanding
43 articles · Page 1 of 1
Tsinghua's Asking the World (ATW) framework enables AI to autonomously build executable physical simulations from video, then use queries, simulations, and interventions to answer physical property, prediction, and counterfactual reasoning questions, achieving 80.82% on CLEVRER and 70.56% on ContPhy benchmarks with Gemini-3-Flash.
ATWAsking the WorldCLEVRER
0 likes · 10 min read

This survey from Oxford, NUS, NTU, and UC Merced presents a unified framework for video world models, distinguishing temporal coherence from world consistency, and organizing research around four operations—reading, writing, sharing, and interacting—while emphasizing that stronger claims require stronger evidence beyond visual fidelity.
Embodied AISurveytemporal coherence
0 likes · 33 min read

The author tests Tencent's Hunyuan Hy4 model across six demanding agent workflows in WorkBuddy — video generation from docs, lecture-to-webpage conversion, game cloning, 3D teardown simulators, industry report generation, and templated PPT creation — finding Hy4 handles 30-40 minute long-horizon tasks with solid code, vision, and planning at $0.55/task, 62% cheaper than Kimi K3.1 Pro.
AI agentsHunyuan Hy4WorkBuddy
0 likes · 8 min read

Oxford University, NUS, and NTU researchers present a unified survey framing video foundation models around four operations—Reading, Writing, Sharing, and Interacting—distinguishing temporal coherence from world consistency, proposing an evidence ladder, and identifying seven open challenges for world modeling.
Oxford surveyWorld Modelsevidence ladder
0 likes · 16 min read

VideoJev replaces autoregressive answer generation with a unified candidate-scoring interface for temporal grounding and multiple-choice QA, achieving 100-129x speedup over thinking-mode baselines while matching accuracy, with open-source 4B and 35B models, though calibration and false-positive issues remain.
Multimodal ModelsVideoJevcandidate scoring
0 likes · 5 min read

Volcano Engine's LAS video fine-grained understanding operator enables automated, scalable video data pipelines for embodied intelligence and autonomous driving, achieving 94.41% dual-arm accuracy, 100k hours/day processing, 90%+ data usability, and cutting annotation effort by 200+ person-days daily while reducing iteration cycles from weeks to days.
Autonomous DrivingLASMultimodal Data
0 likes · 10 min read

This survey reviews vision-language models for egocentric video, analyzing why standard VLMs fail on first-person footage and how hand-object interaction, spatiotemporal reasoning, graph-based representations, and semantic alignment bridge the gap toward embodied AI applications.
Embodied AIGraph Neural NetworksHand-Object Interaction
1 likes · 23 min read

Om AI's VLX-VR model achieves 78.8% accuracy on Google DeepMind's MINERVA long-video reasoning benchmark, outperforming Gemini 3.5 and GPT-4.1, and uniquely improves accuracy on videos over 15 minutes, reversing the typical performance drop with longer videos.
MINERVA benchmarkMultimodal ModelsOm AI
0 likes · 13 min read

Apple researchers propose Internalized Visual Thinking (IVT), a post-training framework that learns predictive world modeling during training but removes future-frame generation at inference, achieving 5x speedup over Visual CoT while matching or exceeding accuracy on Early-event and Next-event Prediction across Ego-Exo4D, Ego4D, and EPIC-KITCHENS-100.
Apple ResearchFlux-VAEInference Optimization
0 likes · 11 min read

VideoChat3 is a 4‑billion‑parameter multimodal large model that unifies short‑video, long‑video, and streaming video understanding through a native spatiotemporal encoder, adaptive resolution budgeting, and four‑stage training, achieving competitive accuracy while dramatically reducing visual token count and inference cost.
Adaptive ResolutionI3D-ViTStreaming video
0 likes · 15 min read

VideoChat3 is a 4‑billion‑parameter multimodal model that introduces an Inflated 3D Vision Transformer and an adaptive frame‑resolution mechanism to efficiently handle short clips, hour‑long videos, and live streams, achieving competitive benchmarks while being fully open‑source.
Adaptive Frame ResolutionI3D-ViTStreaming video
0 likes · 13 min read

The article outlines MOSS's shift from merely expanding multimodal breadth to achieving contextual depth, detailing the design of MOSS‑VL‑Realtime for streaming video, its three interaction modes, architectural innovations, performance gains over prior models, and the release of a lightweight 0.9B multi‑speaker transcription model that sets new benchmarks, while also introducing the Mossland creator platform and the Moss Open Platform for developers.
MOSS-VL-Realtimeaudio diarizationcontextual intelligence
0 likes · 16 min read

LLaVA‑OneVision‑2.0 replaces uniform frame sampling with a codec‑stream visual unit, integrates a OneVision‑Encoder that tokenizes video as state‑plus‑incremental evidence, and demonstrates consistent gains on 18 video, 11 spatial‑reasoning and 4 tracking benchmarks while open‑sourcing its model, data and code.
JumpScoreLLaVA-OneVision-2.0codec stream
0 likes · 17 min read

The article introduces Multi-Stream Scene Script (MTSS), a structured JSON‑based video description paradigm that replaces monolithic captions, explains its design principles, compares its advantages, and presents experimental evidence showing significant gains in both video understanding and generation tasks.
MTSSmultimodal AIstructured video description
0 likes · 8 min read


SuanNiApr 19, 2026 · Artificial Intelligence
The Video‑MME‑v2 benchmark reveals that current multimodal video models, despite high leaderboard scores, struggle with genuine video understanding, thanks to a rigorous three‑layer evaluation, non‑linear scoring, and a meticulously curated 800‑video dataset that exposes their true intelligence limits.
AI-evaluationVideo-MMElarge language models
0 likes · 10 min read

The new Video‑MME‑v2 benchmark reveals that despite saturated high scores on existing video‑understanding tests, the strongest commercial model (Gemini‑3‑Pro) reaches only 49.4 points versus a human expert’s 90.7, highlighting the benchmark’s layered ability system, group‑level non‑linear scoring, and the nuanced impact of "Thinking" features.
AI-evaluationlarge modelsmultimodal benchmark
0 likes · 11 min read

MedGRPO, a multimodal large model, achieves a breakthrough in medical video understanding by introducing clinical semantic parsing that aligns visual cues with structured medical knowledge, boosting performance and raising ethical questions about AI’s evolving role from a supportive assistant to a collaborative clinical partner.
AI ethicsClinical Semantic ParsingMultimodal Model
0 likes · 6 min read

This article details how the Qwen‑Video‑8B model, built on Qwen3‑VL‑8B‑Instruct, is fine‑tuned with the LLaMA‑Factory framework using a curated city‑scenery dataset, addresses challenges of domain knowledge, temporal modeling and multimodal fusion, and demonstrates improved video captioning across baseline, English‑fine‑tuned and Chinese‑fine‑tuned versions.
AI fine-tuningLLaMA-FactoryLoRA
0 likes · 10 min read

CrossVid is an open‑source benchmark that evaluates multimodal large language models on cross‑video reasoning, offering 5,331 videos and 9,015 high‑quality QA pairs across four reasoning dimensions, and revealing that even the strongest models achieve only about 50% accuracy compared with human performance.
AI-evaluationcross-video reasoningvideo understanding
0 likes · 9 min read

CrossVid is an open‑source benchmark that evaluates multimodal large language models on cross‑video reasoning tasks, providing 5,331 videos, 9,015 QA pairs, four high‑level dimensions and ten specific tasks, and exposing significant performance gaps between current models and humans.
AI-evaluationcross-video reasoningmultimodal LLM
0 likes · 9 min read

Kwai has open‑sourced its new flagship multimodal model Keye‑VL‑671B‑A37B, which upgrades visual perception, cross‑modal alignment and complex reasoning, achieving top scores on image, video, and mathematical reasoning benchmarks while detailing its architecture, three‑stage pre‑training, post‑training strategies, and future multimodal agent plans.
deep learninglarge language modelmultimodal
0 likes · 10 min read


AntTechOct 28, 2025 · Artificial Intelligence
Introducing Ming‑Flash‑Omni‑Preview, a 103‑billion‑parameter open‑source multimodal model built on a sparse MoE architecture that delivers state‑of‑the‑art performance in controllable image generation, streaming video understanding, and context‑aware speech recognition, surpassing prior models on GenEval and GEdit benchmarks.
Image GenerationSpeech Recognitionlarge language model
0 likes · 8 min read

Keye‑VL‑1.5, an 8‑billion‑parameter multimodal large language model, introduces a Slow‑Fast video encoding strategy, a four‑stage progressive pre‑training pipeline with 128K context, and a sophisticated post‑training regime that together achieve state‑of‑the‑art performance on video and vision‑language benchmarks while maintaining strong general capabilities.
Pretrainingbenchmarklarge language model
0 likes · 21 min read

Fast‑search platform Kwai has open‑sourced the 8‑billion‑parameter multimodal LLM Keye‑VL‑1.5, which introduces a slow‑fast frame encoding, a progressive four‑stage pre‑training pipeline, and an automated data construction workflow, achieving state‑of‑the‑art results on video and vision‑language benchmarks and surpassing many closed‑source models.
benchmark performancelarge language modelmultimodal AI
0 likes · 12 min read

Kuaishou's foundational large‑model team secured seven papers at the prestigious ACL 2025 conference, covering alignment bias during model training, safety in inference, decoding strategies, fine‑grained video‑temporal understanding, and new evaluation benchmarks that push the frontier of multimodal large language models.
ACL 2025benchmarklarge language models
0 likes · 16 min read

Kuaishou’s foundational large-model team has secured seven papers at ACL 2025, spanning alignment bias in training, safety defenses during inference, decoding strategies, fine-grained video-temporal understanding, reward fairness in RLHF, multimodal captioning benchmarks, and methods to curb hallucinations in vision-language models.
ACLAI safetybenchmark
0 likes · 13 min read


AIWalkerMar 17, 2025 · Artificial Intelligence
The paper introduces UNIFIEDREWARD, the first unified reward model for multimodal understanding and generation that supports pairwise ranking and pointwise scoring, builds a 236K human‑preference dataset across image and video tasks, and uses DPO to align VLMs and diffusion models, achieving significant performance gains on both image and video benchmarks.
Direct Preference OptimizationImage GenerationUnified Reward
0 likes · 19 min read

This article presents the research behind Synchronized Video Storytelling, introducing the E‑SyncVidStory dataset, the VideoNarrator multimodal architecture, and extensive experiments that demonstrate high‑quality, product‑aware video narration generation for e‑commerce applications.
DatasetLLMe-commerce
0 likes · 12 min read

This roundup highlights the latest AI breakthroughs, including Zhipu AI's video‑understanding model for temporal Q&A, Tencent's video‑to‑audio generation system, Vimeo's AI‑content labeling policy, Apple’s Core ML inclusion of ByteDance’s depth model, AMD’s acquisition of Silo AI, Claude’s new editing features, Quark’s all‑in‑one search AI, TikTok’s VR live streaming on Vision Pro, the launch of the "Xinliu" AI search assistant, and Canva’s restrictions on political AI‑generated posters.
AI modelsartificial intelligenceaudio generation
0 likes · 8 min read

The paper presents Action Sensitivity Learning (ASL), a framework that models frame‑wise importance at both class‑level (via learnable Gaussian distributions) and instance‑level (using quality scores), integrates these weights into classification and regression losses, adds a contrastive InfoNCE term, and achieves state‑of‑the‑art temporal action localization performance across six benchmark datasets.
Action Sensitivity LearningComputer VisionTemporal Action Localization
0 likes · 8 min read


HomeTechJul 7, 2023 · Artificial Intelligence
This article presents a comprehensive multi-modal video understanding system for AIGC video generation, detailing technical architecture, GCN-based semi-supervised learning, and practical applications across automotive content scenarios.
AIGCBERTNeXtVLAD
0 likes · 8 min read

This talk presents recent research on integrating dynamic analysis and graph machine learning to generate social relationship graphs from video, detailing hierarchical graph convolution networks, multimodal feature fusion, weakly supervised training, experimental results, and applications such as enhanced video retrieval and storyline understanding.
Graph Neural NetworkWeak Supervisionsocial relationship graph
0 likes · 11 min read

The paper introduces Action Sequence Verification (ASV), a task that determines whether two videos follow the same ordered actions, provides the Chemical Sequence Verification dataset and re‑annotated COIN‑SV and Diving48‑SV sets, and proposes the CosAlignment Transformer (CAT) with intra‑step feature extraction, a Transformer‑based inter‑step encoder, and a sequence‑alignment loss that outperforms prior baselines and serves as a pre‑training model for video retrieval and classification.
Action VerificationComputer VisionDataset
0 likes · 7 min read

This article presents a multimodal approach that combines dynamic analysis and graph machine learning to generate and apply social relationship graphs in videos, detailing problem background, graph generation modules, applications such as video retrieval, experimental results, and future research directions.
AIGraph Neural NetworkWeak Supervision
0 likes · 11 min read


AntTechOct 19, 2021 · Artificial Intelligence
The article introduces pet identity verification using target re‑identification and occluded video instance segmentation, describes recent ICCV VIPriors competitions where Ant Group’s insurance team achieved top ranks, and explains how these computer‑vision techniques are applied to insurance claims, pet identification, and future AI scenarios.
Target Re-identificationinstance segmentationinsurance AI
0 likes · 7 min read

The article shares a Tencent competition champion’s practical TensorFlow‑based video ad solution, detailing data handling, model architecture, optimization tricks, multimodal fusion techniques, and experimental observations to help participants improve performance in the 2021 Tencent Advertising Algorithm Contest.
CompetitionTensorFlowadvertising algorithm
0 likes · 7 min read

Youku’s new text‑video alignment system automatically generates short video summaries by extracting multimodal video and linguistic features, matching sentences to clips through embedding and tag‑level models, and enabling AI‑driven auto‑editing that cuts production time from days to minutes.
BERTNLPcross-modal matching
0 likes · 10 min read

The Boundary Content Graph Neural Network (BC‑GNN) introduces a bipartite‑graph framework that jointly refines start/end boundary probabilities and segment‑content confidence, enabling more precise temporal action proposals and achieving state‑of‑the‑art results on ActivityNet‑1.3 and THUMOS14.
BC-GNNComputer Visiondeep learning
0 likes · 10 min read


ITPUBAug 7, 2020 · Artificial Intelligence
The paper introduces Boundary Content Graph Neural Network (BC‑GNN), a graph‑based approach that jointly models boundary and content predictions to generate more accurate temporal action proposals and reliable confidence scores, achieving state‑of‑the‑art results on ActivityNet‑1.3 and THUMOS‑14.
BC-GNNECCV2020Graph Neural Network
0 likes · 12 min read


HomeTechMar 4, 2020 · Artificial Intelligence
This paper introduces a method for video multi-label classification that incorporates label correlation features using graph convolutional networks, significantly improving classification performance.
Computer VisionGCNInceptionV3
0 likes · 7 min read

This article explores how AI is used in iQIYI's video advertising pipeline to analyze video content, generate and recommend ad placement points, create scene‑aware ad creatives, build a video knowledge graph, and support various ad formats, ultimately improving ad relevance and revenue.
AIad placementknowledge graph
0 likes · 12 min read

This article summarizes Hulu Chief Research Officer Xie Xiaohui’s presentation on why video content understanding is essential, the technical challenges involved, and Hulu’s end‑to‑end solutions—including fine‑grained segmentation, logo and subtitle detection, automated pipelines, tagging taxonomy, content generation, and vector embeddings—to improve recommendation, advertising, and search for massive video libraries.
AIHulucontent tagging
0 likes · 14 min read

This article examines the evolution of search, defines multimedia content retrieval, explores user scenarios such as voice, image, and video input, and details key AI techniques—including OCR, face recognition, and content knowledge graphs—that enable semantic understanding and ranking of video content.
OCRSemantic Searchface recognition
0 likes · 12 min read
