An Adaptive Workflow Scheduling Scheme Based on an Estimated Data Processing Rate for Next Generation Sequencing in Cloud Computing


Byungsang Kim, Chan-Hyun Youn, Yong-Sung Park, Yonggyu Lee, Wan Choi, Journal of Information Processing Systems Vol. 8, No. 4, pp. 555-566, Aug. 2012

10.3745/JIPS.2012.8.4.555
Keywords: Resource-Provisioning, Bio-Workflow Broker, Next-Generation Sequencing
Fulltext:

Abstract

The cloud environment makes it possible to analyze large data sets in a scalable computing infrastructure. In the bioinformatics field, the applications are composed of the complex workflow tasks, which require huge data storage as well as a computing-intensive parallel workload. Many approaches have been introduced in distributed solutions. However, they focus on static resource provisioning with a batchprocessing scheme in a local computing farm and data storage. In the case of a largescale workflow system, it is inevitable and valuable to outsource the entire or a part of their tasks to public clouds for reducing resource costs. The problems, however, occurred at the transfer time for huge dataset as well as there being an unbalanced completion time of different problem sizes. In this paper, we propose an adaptive resourceprovisioning scheme that includes run-time data distribution and collection services for hiding the data transfer time. The proposed adaptive resource-provisioning scheme optimizes the allocation ratio of computing elements to the different datasets in order to minimize the total makespan under resource constraints. We conducted the experiments with a well-known sequence alignment algorithm and the results showed that the proposed scheme is efficient for the cloud environment.


Statistics
Show / Hide Statistics

Statistics (Cumulative Counts from November 1st, 2017)
Multiple requests among the same browser session are counted as one view.
If you mouse over a chart, the values of data points will be shown.




Cite this article
[APA Style]
Byungsang Kim, Chan-Hyun Youn, Yong-Sung Park, Yonggyu Lee, & Wan Choi (2012). An Adaptive Workflow Scheduling Scheme Based on an Estimated Data Processing Rate for Next Generation Sequencing in Cloud Computing. Journal of Information Processing Systems, 8(4), 555-566. DOI: 10.3745/JIPS.2012.8.4.555.

[IEEE Style]
B. Kim, C. Youn, Y. Park, Y. Lee and W. Choi, "An Adaptive Workflow Scheduling Scheme Based on an Estimated Data Processing Rate for Next Generation Sequencing in Cloud Computing," Journal of Information Processing Systems, vol. 8, no. 4, pp. 555-566, 2012. DOI: 10.3745/JIPS.2012.8.4.555.

[ACM Style]
Byungsang Kim, Chan-Hyun Youn, Yong-Sung Park, Yonggyu Lee, and Wan Choi. 2012. An Adaptive Workflow Scheduling Scheme Based on an Estimated Data Processing Rate for Next Generation Sequencing in Cloud Computing. Journal of Information Processing Systems, 8, 4, (2012), 555-566. DOI: 10.3745/JIPS.2012.8.4.555.