The MIT Tech That Lets You Manipulate Video Objects by Analyzing Vibrations

Researchers at MIT’s Computer Science and Artificial Intelligence Laboratory (CSAIL) have found a way to let people reach in and push, pull, poke, and prod objects in videos.

Going a step beyond augmented reality, the Interactive Dynamic Video (IDV) technique captures video with a traditional camera.

Based on the paper, Image-Space Modal Bases for Plausible Manipulation of Objects in Video” ACM Transactions on Graphics (SIGGRAPH Asia 2015) by Abe Davis, Justin Chen and Fredo Durand; this interactive dynamic video demonstration is part of Abe Davis’s PhD dissertation at MIT.

For more information, visit the official project website: www.interactivedynamicvideo.com