DataFunTalk
DataFunTalk
Jan 25, 2024 · Artificial Intelligence

Hierarchical Masked 3D Diffusion Model for Video Outpainting

This paper introduces a hierarchical masked 3D diffusion model (M3DDM) that leverages mask modeling and global-frame cross‑attention to achieve temporally consistent video outpainting, proposes a hybrid coarse‑to‑fine inference pipeline to mitigate error accumulation in long videos, and demonstrates state‑of‑the‑art results on benchmark datasets.

3D U-NetAItemporal consistency
0 likes · 13 min read
Hierarchical Masked 3D Diffusion Model for Video Outpainting
Alimama Tech
Alimama Tech
Jan 24, 2024 · Artificial Intelligence

Hierarchical Masked 3D Diffusion Model for Video Outpainting

The Hierarchical Masked 3D Diffusion Model (M3DDM) introduces a masking‑based training strategy and cross‑attention with global video clips to achieve temporally consistent video outpainting, while a hybrid coarse‑to‑fine inference pipeline mitigates error accumulation, delivering state‑of‑the‑art results and deployment in Alibaba’s creative center.

3D diffusionACM MM2023AI video processing
0 likes · 12 min read
Hierarchical Masked 3D Diffusion Model for Video Outpainting
Alimama Tech
Alimama Tech
Aug 2, 2023 · Artificial Intelligence

Can AI Fully Automate Advertising Poster Creation and Video Outpainting?

This article reviews four ACM MM 2023 papers that introduce AI‑driven systems for automatic advertising poster generation, multimodal text‑image creation, few‑shot style‑guided visual captioning, and hierarchical 3D diffusion models for video outpainting, detailing their methods, datasets, and experimental results.

AI-generated designDiffusion ModelsPoster Automation
0 likes · 9 min read
Can AI Fully Automate Advertising Poster Creation and Video Outpainting?