Multi-channel Long Short-Term Memory with Domain Knowledge for Context Awareness and User Intention


Dan-Bi Cho, Hyun-Young Lee, Seung-Shik Kang, Journal of Information Processing Systems Vol. 17, No. 5, pp. 867-878, Oct. 2021  

10.3745/JIPS.02.0163
Keywords: Context Awareness, domain adaptation, Multi-channel LSTM, User Intention
Fulltext:

Abstract

In context-awareness and user intention tasks, dataset construction is expensive because specific domain data are required. Although pretraining with a large corpus can effectively resolve the issue of lack of data, it ignores domain knowledge. Herein, we concentrate on data domain knowledge while addressing data scarcity and accordingly propose a multi-channel long short-term memory (LSTM). Because multi-channel LSTM integrates pretrained vectors such as task and general knowledge, it effectively prevents catastrophic forgetting between vectors of task and general knowledge to represent the context as a set of features. To evaluate the proposed model with reference to the baseline model, which is a single-channel LSTM, we performed two tasks: voice phishing with context awareness and movie review sentiment classification. The results verified that multichannel LSTM outperforms single-channel LSTM in both tasks. We further experimented on different multichannel LSTMs depending on the domain and data size of general knowledge in the model and confirmed that the effect of multi-channel LSTM integrating the two types of knowledge from downstream task data and raw data to overcome the lack of data.


Statistics
Show / Hide Statistics

Statistics (Cumulative Counts from November 1st, 2017)
Multiple requests among the same browser session are counted as one view.
If you mouse over a chart, the values of data points will be shown.




Cite this article
[APA Style]
Cho, D., Lee, H., & Kang, S. (2021). Multi-channel Long Short-Term Memory with Domain Knowledge for Context Awareness and User Intention. Journal of Information Processing Systems, 17(5), 867-878. DOI: 10.3745/JIPS.02.0163.

[IEEE Style]
D. Cho, H. Lee, S. Kang, "Multi-channel Long Short-Term Memory with Domain Knowledge for Context Awareness and User Intention," Journal of Information Processing Systems, vol. 17, no. 5, pp. 867-878, 2021. DOI: 10.3745/JIPS.02.0163.

[ACM Style]
Dan-Bi Cho, Hyun-Young Lee, and Seung-Shik Kang. 2021. Multi-channel Long Short-Term Memory with Domain Knowledge for Context Awareness and User Intention. Journal of Information Processing Systems, 17, 5, (2021), 867-878. DOI: 10.3745/JIPS.02.0163.