Tag

image animation

0 views collected around this technical thread.

Baidu Geek Talk
Baidu Geek Talk
Mar 8, 2023 · Artificial Intelligence

Understanding Motion Decomposition in AI-Based Image Animation: From Sparse to Dense Optical Flow

The article details how AI‑based image animation and face‑swapping decompose video motion into zero‑order rigid and first‑order affine components via Taylor expansion, using unsupervised U‑Net keypoint extraction, sparse-to-dense optical flow conversion, and dense motion networks that learn masks for region‑wise rigidity and non‑rigid deformation.

Neural NetworksTaylor expansionaffine transformation
0 likes · 21 min read
Understanding Motion Decomposition in AI-Based Image Animation: From Sparse to Dense Optical Flow
Alimama Tech
Alimama Tech
Jun 22, 2022 · Artificial Intelligence

Deformable Anchor Model for Image‑Driven Motion Transfer

The Deformable Anchor Model (DAM) and its hierarchical extension (HDAM) enhance image‑driven motion transfer by introducing a learned root (and intermediate) node as a structural prior for keypoint detection, yielding clearer motions, lower reconstruction errors across multiple benchmarks, while preserving the speed of the original First‑Order Motion Model.

FOMMcomputer visiondeformable keypoint model
0 likes · 12 min read
Deformable Anchor Model for Image‑Driven Motion Transfer