Malika Douache, Badra Nawal Benmoussat, Journal of Information Processing Systems Vol. 19, No. 6, pp. 730-744, Dec. 2023  

10.3745/JIPS.02.0207
Keywords: Convolutional Neural Network, Deep Learning, Egocentric Vision (or First-Person Vision), Human Activity Recognition, Image Classification, Inertial Measurement Unit (IMU)
Fulltext: PDF Full Text PubReader

Abstract

The topic of this paper is the recognition of human activities using egocentric vision, particularly captured by body-worn cameras, which could be helpful for video surveillance, automatic search and video indexing. This being the case, it could also be helpful in assistance to elderly and frail persons for revolutionizing and improving their lives. The process throws up the task of human activities recognition remaining problematic, because of the important variations, where it is realized through the use of an external device, similar to a robot, as a personal assistant. The inferred information is used both online to assist the person, and offline to support the personal assistant. With our proposed method being robust against the various factors of variability problem in action executions, the major purpose of this paper is to perform an efficient and simple recognition method from egocentric camera data only using convolutional neural network and deep learning. In terms of accuracy improvement, simulation results outperform the current state of the art by a significant margin of 61% when using egocentric camera data only, more than 44% when using egocentric camera and several stationary cameras data and more than 12% when using both inertial measurement unit (IMU) and egocentric camera data.

Statistics
Cite this article