Abstract
Anomaly detection is an important issue in the fields of video behavior analysis and computer vision. Genetic Programming (GP) performs well in those applications. Histogram of Oriented Optical Flow (HOOF), which is based on Optical Flow (OF), is a significant method to extract features of frames in videos and has been widely used in computer vision. However, OF may produce a large number of features that will lead to high computational cost and poor performance. Moreover, HOOF accumulates optical flow values for moving objects in a region, so motion information of these objects may not be well represented. Especially in crowding scenes, common anomaly detection methods usually have a poor performance. Aiming to address the above issues, we propose a new feature called Multi-Dimensional Optical Flow (MDOF) and a new method GP-MDOF which embeds HOOF features and optimizes the structure of GP, and makes better use of the change information between consecutive frames. In this paper, we apply GP-MDOF to classify frames into abnormality or not. Experimental evaluations are conducted on the public dataset UMN, UCSD Ped1 and Ped2. Our experimental results indicate that the proposed feature extraction method MDOF and the new method GP-MDOF can outperform the popular techniques such as OF and Social Force Model in anomaly detection in crowded scenes.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Bertini, M., Del Bimbo, A., Seidenari, L.: Scene and crowd behaviour analysis with local space-time descriptors. In: 2012 5th International Symposium on Communications Control and Signal Processing (ISCCSP), pp. 1–6. IEEE (2012)
Chaudhry, R., Ravichandran, A., Hager, G., Vidal, R.: Histograms of oriented optical flow and Binet-Cauchy kernels on nonlinear dynamical systems for the recognition of human actions. In: IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2009, pp. 1932–1939. IEEE (2009)
Chin, B., Zhang, M.: Object detection using neural networks and genetic programming. In: Giacobini, M., et al. (eds.) EvoWorkshops 2008. LNCS, vol. 4974, pp. 335–340. Springer, Heidelberg (2008). https://doi.org/10.1007/978-3-540-78761-7_34
Cong, Y., Yuan, J., Liu, J.: Sparse reconstruction cost for abnormal event detection. In: 2011 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3449–3456. IEEE (2011)
Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2005, vol. 1, pp. 886–893. IEEE (2005)
Dee, H.M., Hogg, D.C.: Detecting inexplicable behaviour. In: BMVC, pp. 1–10 (2004)
Howard, D., Roberts, S.C., Ryan, C.: Pragmatic genetic programming strategy for the problem of vehicle detection in airborne reconnaissance. Pattern Recognit. Lett. 27(11), 1275–1288 (2006)
Kim, B., Lee, G.-G., Yoon, J.-Y., Kim, J.-J., Kim, W.-Y.: A method of counting pedestrians in crowded scenes. In: Huang, D.-S., Wunsch, D.C., Levine, D.S., Jo, K.-H. (eds.) ICIC 2008. LNCS (LNAI), vol. 5227, pp. 1117–1126. Springer, Heidelberg (2008). https://doi.org/10.1007/978-3-540-85984-0_134
Kim, J., Grauman, K.: Observe locally, infer globally: a space-time MRF for detecting abnormal activities with incremental updates. In: IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2009, pp. 2921–2928. IEEE (2009)
Koza, J.R.: Genetic programming as a means for programming computers by natural selection. Stat. Comput. 4(2), 87–112 (1994)
Kratz, L., Nishino, K.: Anomaly detection in extremely crowded scenes using spatio-temporal motion pattern models. In: IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2009, pp. 1446–1453. IEEE (2009)
Li, W., Mahadevan, V., Vasconcelos, N.: Anomaly detection and localization in crowded scenes. IEEE Trans. Pattern Anal. Mach. Intell. 36(1), 18–32 (2014)
Lu, C., Shi, J., Jia, J.: Abnormal event detection at 150 fps in MATLAB. In: 2013 IEEE International Conference on Computer Vision (ICCV), pp. 2720–2727. IEEE (2013)
Mahadevan, V., Li, W., Bhalodia, V., Vasconcelos, N.: Anomaly detection in crowded scenes. In: 2010 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1975–1981. IEEE (2010)
Mehran, R., Oyama, A., Shah, M.: Abnormal crowd behavior detection using social force model. In: IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2009, pp. 935–942. IEEE (2009)
Pinto, B., Song, A.: Detecting motion from noisy scenes using genetic programming. In: 24th International Conference on Image and Vision Computing New Zealand, IVCNZ 2009, pp. 322–327. IEEE (2009)
Robertson, N., Reid, I.: Behaviour understanding in video: a combined method. In: Tenth IEEE International Conference on Computer Vision, ICCV 2005, vol. 1, pp. 808–815. IEEE (2005)
Shi, Y., Gao, Y., Wang, R.: Real-time abnormal event detection in complicated scenes. In: 2010 20th International Conference on Pattern Recognition (ICPR), pp. 3653–3656. IEEE (2010)
Song, A., Fang, D.: Robust method of detecting moving objects in videos evolved by genetic programming. In: Proceedings of the 10th Annual Conference on Genetic and Evolutionary Computation, pp. 1649–1656. ACM (2008)
Song, A., Zhang, M.: Genetic programming for detecting target motions. Connect. Sci. 24(2–3), 117–141 (2012)
Sun, X., Yao, H., Ji, R., Liu, X., Xu, P.: Unsupervised fast anomaly detection in crowds. In: Proceedings of the 19th ACM International Conference on Multimedia, pp. 1469–1472. ACM (2011)
Tudor Ionescu, R., Smeureanu, S., Alexe, B., Popescu, M.: Unmasking the abnormal events in video. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2895–2903 (2017)
Wang, T., Snoussi, H.: Detection of abnormal visual events via global optical flow orientation histogram. IEEE Trans. Inf. Forensics Secur. 9(6), 988–998 (2014)
Xu, D., Yan, Y., Ricci, E., Sebe, N.: Detecting anomalous events in videos by learning deep representations of appearance and motion. Comput. Vis. Image Underst. 156, 117–127 (2017)
Yang, C., Yuan, J., Liu, J.: Abnormal event detection in crowded scenes using sparse representation. Pattern Recogn. 46(7), 1851–1864 (2013)
Acknowledgement
This work is supported by the National Natural Science Foundation of China (No. 61672276) and Natural Science Foundation of Jiangsu, China (BK20161406).
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer Nature Switzerland AG
About this paper
Cite this paper
Mi, Z., Shang, L., Xue, B. (2018). Multi-Dimensional Optical Flow Embedded Genetic Programming for Anomaly Detection in Crowded Scenes. In: Cheng, L., Leung, A., Ozawa, S. (eds) Neural Information Processing. ICONIP 2018. Lecture Notes in Computer Science(), vol 11302. Springer, Cham. https://doi.org/10.1007/978-3-030-04179-3_43
Download citation
DOI: https://doi.org/10.1007/978-3-030-04179-3_43
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-04178-6
Online ISBN: 978-3-030-04179-3
eBook Packages: Computer ScienceComputer Science (R0)