DaTaobao Tech

Mar 21, 2022 · Artificial Intelligence

Neural Rendering Based 3D Modeling and Multi‑Video Visual Localization for E‑commerce

The paper presents Object Drawer, a Taobao Tech system that uses neural‑rendering and a SuperPoint‑SuperGlue‑based SfM pipeline—enhanced by sparse sampling, loop constraints, frame‑skipping, and a novel 2D‑matching‑3D‑solving alignment across multiple videos—to achieve 99.3% visual‑localization success and high‑quality 3‑D reconstructions with pixel‑accurate segmentation for e‑commerce displays.