NIPS 2008 – Nonrigid Structure from Motion in Trajectory Space

Ijaz Akhter, Yaser Sheikh, Sohaib Khan, Takeo Kanade
22nd Annual Conference on Neural Information Processing Systems, NIPS, Dec 2008
(Best Student Paper Nomination, ORAL, 2.7% acceptance rate) 

Abstract

Existing approaches to nonrigid structure from motion assume that the instantaneous 3D shape of a deforming object is a linear combination of basis shapes, which have to be estimated anew for each video sequence. In contrast, we propose that the evolving 3D structure be described by a linear combination of basis trajectories. The principal advantage of this approach is that we do not need to estimate any basis vectors during computation. We show that generic bases over trajectories, such as the Discrete Cosine Transform (DCT) basis, can be used to compactly describe most real motions. This results in a significant reduction in unknowns, and corresponding stability in estimation. We report empirical performance, quantitatively using motion capture data, and qualitatively on several video sequences exhibiting nonrigid motions including piece-wise rigid motion, partially nonrigid motion (such as a facial expression), and highly nonrigid motion (such as a person dancing).

Resources

Download PDF
(Distributed here for timely dissemination of scholarly work. Copyright retained by copyright holders. May not be posted without permission from copyright holders.)

Text Reference:

Ijaz Akhter, Yaser Sheikh, Sohaib Khan, Takeo Kanade,
 "Nonrigid Structure from Motion in Trajectory Space",
 in Proceedings of 22nd Annual Conference on Neural Information Processing Systems, NIPS 2008, Vancouver, Canada, pp. 41-48, December 2008

Bibtex Reference:

@inproceedings{akhter2008nonrigid,
  title={Nonrigid structure from motion in trajectory space},
  author={Akhter, I. and Sheikh, Y. and Khan, S. and Kanade, T. and others},
  booktitle={Neural Information Processing Systems},
  pages={41--48},
  year={2008}
}