audio-driven animation

AntTech

Nov 27, 2024 · Artificial Intelligence

EchoMimicV2: An End-to-End Audio‑Driven Semi‑Body Human Animation Framework

EchoMimicV2, an open‑source project from Ant Group's Alipay AI team, introduces an end‑to‑end audio‑driven framework that generates high‑quality semi‑body portrait videos by jointly coordinating audio, pose, and image inputs, while addressing challenges of condition complexity, model stability, and computational cost.

AI researchDigital HumanMultimodal Generation

0 likes · 16 min read

EchoMimicV2: An End-to-End Audio‑Driven Semi‑Body Human Animation Framework

AntTech

Jul 24, 2024 · Artificial Intelligence

EchoMimic: An Open‑Source AIGC‑Driven Framework for 2D/3D Digital Human Generation

EchoMimic, an open‑source project from Ant Group, presents a flexible, audio‑ and pose‑driven digital human generation pipeline that combines 2D, 3D and AIGC techniques, reduces production costs, achieves real‑time inference, and includes a detailed architecture, related work analysis, and future research directions.

AIGCDigital Humanaudio-driven animation

0 likes · 18 min read

EchoMimic: An Open‑Source AIGC‑Driven Framework for 2D/3D Digital Human Generation