ControlFoley: An Open‑Source Model for Fully Controllable Video Sound Generation

ControlFoley, released by Xiaomi's large‑model team, is an open‑source framework that lets creators generate video‑aligned sound effects while explicitly controlling content, style, and timing through text prompts, video dubbing, or reference audio, achieving SOTA performance on multiple benchmarks.

ControlFoleyMultimodalOpen Source

0 likes · 15 min read

ControlFoley: An Open‑Source Model for Fully Controllable Video Sound Generation