Spatio-Temporal Interpolation

Movie 1

<iframe width="1020" height="440" src="" frameborder="0" allow="accelerometer; autoplay; encrypted-media; gyroscope; picture-in-picture" allowfullscreen></iframe>

Movie-1 This movie shows that we can reliably recover the shape of dynamically occluded objects (people in this case) whose projection to the eyes is occluded by intervening shrubs. At a given instance the leaves admit only small portions of the human figure. It can be seen by stopping the movie at any instance that the information available in a single frame is insufficient to identify the human. However, our visual system processes the available information over space and time in a way such that we perceive connected object.

The primary concern of this project is to understand processes and mechanisms by which the visual system produces stable and coherent representation of contours, surfaces and objects from incoming information that is fragmentary in space and time. We are using eye-tracking and psychophysical methods to understand spatiotemporal interpolation (please see below for examples).

  • STI and Surface properties The goal of this project is to investigate the nature of interaction between contour-based and surface-based processes contributing to spatiotemporal interpolation.
  • STI and Metric properties The purpose of this study is to investigate whether mertic properties such as length can be accurately recovered by spatiotemporal interpolation.
Submission for Demo Night for VSS 2009
Spatiotemporal Interpolation Contour Relatability vs. Surface Properties
Spatiotemporal Interpolation & Length Recovery
Spatiotemporal Boundary Formation Demos Kellman lab UCLA