Design of HCI System of Museum Guide Robot Based onVisual Communication Skill


Qingqing Liang, Journal of Information Processing Systems Vol. 20, No. 3, pp. 328-336, Jun. 2024  

https://doi.org/10.3745/JIPS.02.0214
Keywords: Guided Robot, HCI, Neural Network, visual communication
Fulltext:

Abstract

Visual communication is widely used and enhanced in modern society, where there is an increasing demand for spirituality. Museum robots are one of many service robots that can replace humans to provide services such as display, interpretation and dialogue. For the improvement of museum guide robots, the paper proposes a humanrobot interaction system based on visual communication skills. The system is based on a deep neural mesh structure and utilizes theoretical analysis of computer vision to introduce a Tiny+CBAM mesh structure in the gesture recognition component. This combines basic gestures and gesture states to design and evaluate gesture actions. The test results indicated that the improved Tiny+CBAM mesh structure could enhance the mean average precision value by 13.56% while maintaining a loss of less than 3 frames per second during static basic gesture recognition. After testing the system's dynamic gesture performance, it was found to be over 95% accurate for all items except double click. Additionally, it was 100% accurate for the action displayed on the current page.


Statistics
Show / Hide Statistics

Statistics (Past 3 Years)
Multiple requests among the same browser session are counted as one view.
If you mouse over a chart, the values of data points will be shown.




Cite this article
[APA Style]
Liang, Q. (2024). Design of HCI System of Museum Guide Robot Based onVisual Communication Skill. Journal of Information Processing Systems, 20(3), 328-336. DOI: 10.3745/JIPS.02.0214.

[IEEE Style]
Q. Liang, "Design of HCI System of Museum Guide Robot Based onVisual Communication Skill," Journal of Information Processing Systems, vol. 20, no. 3, pp. 328-336, 2024. DOI: 10.3745/JIPS.02.0214.

[ACM Style]
Qingqing Liang. 2024. Design of HCI System of Museum Guide Robot Based onVisual Communication Skill. Journal of Information Processing Systems, 20, 3, (2024), 328-336. DOI: 10.3745/JIPS.02.0214.