ICIP 2012 – Interaction Recognition in Wide Areas Using Audiovisual Sensors

Murtaza Taj, Andrea Cavallaro
International Conference on Image Processing, ICIP 2012

Abstract

We present an event recognition framework to detect interactions among objects, for example people, using a network of cameras and associated microphone pairs. The complementarity of the video and audio modalities is exploited to cover wide areas. In particular, object movements in portions of the scene that are not covered by the cameras’ fields of view are estimated using the input from microphones. After estimating trajectories using audio-visual features, we recognize interactions based on a Coupled Hidden Markov Model Maximum a Posteriori (CHMM-MAP) approach. The states of the CHMM are initialized via Gaussian Mixture Model (GMM) clustering on a multi-dimensional feature space. Evaluation and comparison with three alternative methods demonstrate the effectiveness of the proposed CHMM-MAP trained on multiple features on both synthetic and real data.

Resources

Download PDF
(Distributed here for timely dissemination of scholarly work. Copyright retained by copyright holders. May not be posted without permission from copyright holders.)

Text Reference:

Murtaza Taj, Andrea Cavallaro,
" Interaction Recognition in Wide Areas Using Audiovisual Sensors",
in Proceedings of the IEEE International Conference on Image Processing, ICCP, September 2012

Bibtex Reference:

@inproceedings{TajICIP12,
  author = "M. Taj and A. Cavallaro",
  title = "Interaction Recognition in Wide Areas Using Audiovisual Sensors",
  booktitle = Proceedings of the IEEE International Conference on Image Processing",
  year = "2012",
  address = "Orlando, FL, USA",
  month = "September"
}