A Facial Expression Recognition Method Using Two-Stream Convolutional Networks in Natural Scenes


Lixin Zhao, Journal of Information Processing Systems Vol. 17, No. 2, pp. 399-410, Apr. 2021  

https://doi.org/10.3745/JIPS.01.0070
Keywords: Attentional Mechanism, Confrontational Learning, Double Flow Convolutional Neural Network, Image Preprocessing, Natural Scene Expression Recognition
Fulltext:

Abstract

Aiming at the problem that complex external variables in natural scenes have a greater impact on facial expression recognition results, a facial expression recognition method based on two-stream convolutional neural network is proposed. The model introduces exponentially enhanced shared input weights before each level of convolution input, and uses soft attention mechanism modules on the space-time features of the combination of static and dynamic streams. This enables the network to autonomously find areas that are more relevant to the expression category and pay more attention to these areas. Through these means, the information of irrelevant interference areas is suppressed. In order to solve the problem of poor local robustness caused by lighting and expression changes, this paper also performs lighting preprocessing with the lighting preprocessing chain algorithm to eliminate most of the lighting effects. Experimental results on AFEW6.0 and Multi-PIE datasets show that the recognition rates of this method are 95.05% and 61.40%, respectively, which are better than other comparison methods.


Statistics
Show / Hide Statistics

Statistics (Past 3 Years)
Multiple requests among the same browser session are counted as one view.
If you mouse over a chart, the values of data points will be shown.




Cite this article
[APA Style]
Zhao, L. (2021). A Facial Expression Recognition Method Using Two-Stream Convolutional Networks in Natural Scenes. Journal of Information Processing Systems, 17(2), 399-410. DOI: 10.3745/JIPS.01.0070.

[IEEE Style]
L. Zhao, "A Facial Expression Recognition Method Using Two-Stream Convolutional Networks in Natural Scenes," Journal of Information Processing Systems, vol. 17, no. 2, pp. 399-410, 2021. DOI: 10.3745/JIPS.01.0070.

[ACM Style]
Lixin Zhao. 2021. A Facial Expression Recognition Method Using Two-Stream Convolutional Networks in Natural Scenes. Journal of Information Processing Systems, 17, 2, (2021), 399-410. DOI: 10.3745/JIPS.01.0070.