MultiMedia Surveillance (MMS) Data Set

Description

This data was collected at the School of Computing, National University of Singapore (during 2003-06) as a part of the work "Information Assimilation in Multimedia Surveillance Systems". It consists of 43 audio-visual events captured via two cameras (Canon VC-C50i) and two USB microphones in a corridor scenario. The data set is being made public for research purpose only. The users of this data are expected to cite this website and the papers (listed below) that resulted from this work.

An example event

A person walks toward Cam2

Camera 1 images Camera 1 Camera 1 Camera 1 Camera 1 Camera 1
Mic 1 audio Mic 1
Camera 2 images Camera 2 Camera 2 Camera 2 Camera 2 Camera 2
Mic 2 audio Mic 2

The data for this event can downloaded from: [Camera 1 & Microphone 1 data], [Camera 2 & Microphone 2 data]


Download

The complete data set can be found below:

Summary of events (Total 43 events)
Camera 1 & Microphone 1 data (843 MB)
Camera 2 & Microphone 2 data (711 MB)

Publications

- P. K. Atrey and A. El Saddik. Confidence evolution in multimedia systems. IEEE Transactions on Multimedia, 10(7):1288-1298 (2008).
- P. K. Atrey and M. S. Kankanhalli and John B. Oommen. Goal-oriented optimal subset selection of correlated multimedia streams. ACM Transactions on Multimedia Computing, Communications and Applications, Vol. 3, Issue 1, Article 2 (2007).
- P. K. Atrey, M. S. Kankanhalli and R. Jain. Information assimilation framework for event detection in multimedia surveillance systems. Springer/ACM Multimedia Systems Journal, Vol. 12, No. 3, pp 239-253 (2006).
- P. K. Atrey, V. Kumar, A. Kumar and M. S. Kankanhalli. Experiential sampling based foreground/background segmentation for video surveillance. IEEE International Conference on Multimedia and Expo (ICME'2006), pp 1809-1812, July, 2006, Toronto, Canada.
- P. K. Atrey, N. C. Maddage and M. S. Kankanhalli. Audio based event detection for multimedia surveillance. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP'2006), pp V813-816, May, 2006, Toulouse, France.
- P. K. Atrey, M. S. Kankanhalli and R. Jain. Timeline-based information assimilation in multimedia surveillance and monitoring systems, 3rd ACM International Workshop on Video Surveillance and Sensor Networks (ACM VSSN'05), pp 103-112, November, 2005, Singapore.
- P. K. Atrey and M. S. Kankanhalli. Goal based optimal selection of media streams. IEEE International Conference on Multimedia & Expo (ICME'05), pp 305-308, July, 2005, Amsterdam, The Netherlands.
- P. K. Atrey and M. S. Kankanhalli. Probability fusion for correlated multimedia streams. ACM International Conference on Multimedia (MM'04), pp 408-411, October, 2004, New York City, NY, USA.

Questions?

Any query can be directed to: Pradeep Atrey.