Resource Efficient AI Service Framework Associated with a Real-Time Object Detector


Jun-Hyuk Choi, Jeonghun Lee, and Kwang-il Hwang, Journal of Information Processing Systems Vol. 19, No. 4, pp. 439-449, Aug. 2023  

https://doi.org/10.3745/JIPS.04.0280
Keywords: Adaptive AI Service, Multichannel Streaming, Object Detection, Real-Time, Resource Efficient
Fulltext:

Abstract

This paper deals with a resource efficient artificial intelligence (AI) service architecture for multi-channel video streams. As an AI service, we consider the object detection model, which is the most representative for video applications. Since most object detection models are basically designed for a single channel video stream, the utilization of the additional resource for multi-channel video stream processing is inevitable. Therefore, we propose a resource efficient AI service framework, which can be associated with various AI service models. Our framework is designed based on the modular architecture, which consists of adaptive frame control (AFC) Manager, multiplexer (MUX), adaptive channel selector (ACS), and YOLO interface units. In order to run only a single YOLO process without regard to the number of channels, we propose a novel approach efficiently dealing with multi-channel input streams. Through the experiment, it is shown that the framework is capable of performing object detection service with minimum resource utilization even in the circumstance of multichannel streams. In addition, each service can be guaranteed within a deadline.


Statistics
Show / Hide Statistics

Statistics (Past 3 Years)
Multiple requests among the same browser session are counted as one view.
If you mouse over a chart, the values of data points will be shown.




Cite this article
[APA Style]
Choi, J., Lee, J., & Hwang, a. (2023). Resource Efficient AI Service Framework Associated with a Real-Time Object Detector. Journal of Information Processing Systems, 19(4), 439-449. DOI: 10.3745/JIPS.04.0280.

[IEEE Style]
J. Choi, J. Lee, a. K. Hwang, "Resource Efficient AI Service Framework Associated with a Real-Time Object Detector," Journal of Information Processing Systems, vol. 19, no. 4, pp. 439-449, 2023. DOI: 10.3745/JIPS.04.0280.

[ACM Style]
Jun-Hyuk Choi, Jeonghun Lee, and and Kwang-il Hwang. 2023. Resource Efficient AI Service Framework Associated with a Real-Time Object Detector. Journal of Information Processing Systems, 19, 4, (2023), 439-449. DOI: 10.3745/JIPS.04.0280.