video inpainting

Kuaishou Audio & Video Technology

Sep 29, 2022 · Artificial Intelligence

How DeViT Revolutionizes Video Inpainting with Deformed Vision Transformers

The article introduces DeViT, a novel Deformed Vision Transformer framework for video inpainting that leverages a deformable patch homography estimator, mask‑pruned attention, and spatio‑temporal weight adaptation, achieving state‑of‑the‑art results on benchmark datasets and highlighting its potential for advanced video editing tools.

DeViTcomputer visiondeep learning

0 likes · 10 min read

How DeViT Revolutionizes Video Inpainting with Deformed Vision Transformers

Cyber Elephant Tech Team

Mar 30, 2022 · Artificial Intelligence

Can AI Make Real-Life Invisibility Cloaks? Inside the STTN Video Restoration Breakthrough

This article reviews the challenges of video inpainting, surveys traditional methods, and introduces the Spatial‑Temporal Transformer Network (STTN) that leverages multi‑scale attention and a Temporal Patch‑GAN discriminator, detailing its architecture, loss functions, training on Youtube‑VOS, and impressive restoration results.

AI video restorationdeep learningspatial-temporal transformer

0 likes · 10 min read

Can AI Make Real-Life Invisibility Cloaks? Inside the STTN Video Restoration Breakthrough