Abnormal Behavior Recognition Based on Spatio-temporal Context


Yuanfeng Yang, Lin Li, Zhaobin Liu, Gang Liu, Journal of Information Processing Systems Vol. 16, No. 3, pp. 612-628, Jun. 2020  

https://doi.org/10.3745/JIPS.02.0134
Keywords: Abnormal Behavior Recognition, Cascade Model, Spatio-temporal Context, Topic Model
Fulltext:

Abstract

This paper presents a new approach for detecting abnormal behaviors in complex surveillance scenes where anomalies are subtle and difficult to distinguish due to the intricate correlations among multiple objects’ behaviors. Specifically, a cascaded probabilistic topic model was put forward for learning the spatial context of local behavior and the temporal context of global behavior in two different stages. In the first stage of topic modeling, unlike the existing approaches using either optical flows or complete trajectories, spatio-temporal correlations between the trajectory fragments in video clips were modeled by the latent Dirichlet allocation (LDA) topic model based on Markov random fields to obtain the spatial context of local behavior in each video clip. The local behavior topic categories were then obtained by exploiting the spectral clustering algorithm. Based on the construction of a dictionary through the process of local behavior topic clustering, the second phase of the LDA topic model learns the correlations of global behaviors and temporal context. In particular, an abnormal behavior recognition method was developed based on the learned spatio-temporal context of behaviors. The specific identification method adopts a top-down strategy and consists of two stages: anomaly recognition of video clip and anomalous behavior recognition within each video clip. Evaluation was performed using the validity of spatio-temporal context learning for local behavior topics and abnormal behavior recognition. Furthermore, the performance of the proposed approach in abnormal behavior recognition improved effectively and significantly in complex surveillance scenes.


Statistics
Show / Hide Statistics

Statistics (Cumulative Counts from November 1st, 2017)
Multiple requests among the same browser session are counted as one view.
If you mouse over a chart, the values of data points will be shown.




Cite this article
[APA Style]
Yang, Y., Li, L., Liu, Z., & Liu, G. (2020). Abnormal Behavior Recognition Based on Spatio-temporal Context. Journal of Information Processing Systems, 16(3), 612-628. DOI: 10.3745/JIPS.02.0134.

[IEEE Style]
Y. Yang, L. Li, Z. Liu, G. Liu, "Abnormal Behavior Recognition Based on Spatio-temporal Context," Journal of Information Processing Systems, vol. 16, no. 3, pp. 612-628, 2020. DOI: 10.3745/JIPS.02.0134.

[ACM Style]
Yuanfeng Yang, Lin Li, Zhaobin Liu, and Gang Liu. 2020. Abnormal Behavior Recognition Based on Spatio-temporal Context. Journal of Information Processing Systems, 16, 3, (2020), 612-628. DOI: 10.3745/JIPS.02.0134.