Netflix Launches VOID Video Deletion Model

🔑 Enhanced Key Takeaways

• •VOID (Video Object and Interaction Deletion) is a research-oriented model developed by Netflix in collaboration with INSAIT and Sofia University, specifically designed to handle counterfactual scene evolution by removing not just objects, but also their physical effects like shadows, reflections, and induced collisions.
• •The model is built on top of the CogVideoX-Fun-V1.5-5b architecture and utilizes a two-pass inference pipeline, where the first pass predicts new motion and the second pass applies warped-noise refinement to improve temporal consistency.
• •In human preference studies on real-world video datasets, VOID outperformed existing baselines such as Runway (Aleph), Generative Omnimatte, and ProPainter, achieving a 64.8% selection rate.

🛠️ Technical Deep Dive

• •Base Architecture: Fine-tuned on CogVideoX-Fun-V1.5-5b (5 billion parameter video diffusion model).
• •Input Requirements: Video, text prompt describing the scene post-removal, and a quadmask (marking regions to remove, preserve, or treat as affected).
• •Inference Pipeline: Two-pass system; Pass 1 for motion prediction, Pass 2 for warped-noise refinement to enhance temporal consistency.
• •Hardware Requirements: High-end GPU with 40GB+ VRAM (e.g., NVIDIA A100 or equivalent).
• •Resolution/Capacity: Supports up to 197 frames at 384×672 resolution.
• •Training Data: Utilizes counterfactual training data generated via Kubric and HUMOTO.

🔮 Future ImplicationsAI analysis grounded in cited sources

⏳ Timeline