| 大数据流计算环境下的低延时高可靠性的资源调度方法 |
| |
| 引用本文： | 孙怀英,虞慧群,范贵生,陈丽琼.大数据流计算环境下的低延时高可靠性的资源调度方法[J].医学教育探索,2017,43(6):855-862. |
| |
| 作者姓名： | 孙怀英 虞慧群 范贵生 陈丽琼 |
| |
| 作者单位： | 华东理工大学计算机科学与工程系, 上海 200237;上海市计算机软件评测重点实验室, 上海 201112,华东理工大学计算机科学与工程系, 上海 200237,华东理工大学计算机科学与工程系, 上海 200237,上海应用技术学院计算机科学与信息工程系, 上海 200235 |
| |
| 基金项目： | 国家自然科学基金（61173048，61300041）；高等学校博士学科点专向科研基金（20130074110015）；中央高校基本科研业务费专项基金（WH1314038） |
| |
| 摘 要： | 在大数据处理过程中，如何保证流数据处理的可靠性及实时性变得日益重要。本文使用数据流图（DSG）对大数据流应用过程进行描述，并将DSG表示为扩展的Petri网以便对数据流过程进行建模。提出了基于CPU利用率平均变化率的资源熵算法计算资源组可靠性，并根据资源熵算法提出了基于时间和可靠性的资源调度算法（TRS-SCHE）以获得高可靠性、低延时的资源调度方案。通过仿真实验，模拟实现soda交通大数据分析应用并进行资源的调度，验证了TRS-SCHE相比于Storm隔离调度算法在响应时间、请求失败率和算法时间复杂度方面的优势。
|
| 关 键 词： | DSG 高可靠性 低延时 资源熵 响应时间 |
| 收稿时间： | 2016/12/27 0:00:00 |
Low Latency and High-Reliability Resource Scheduling Method in Big Data Streaming Computing Environment |
| |
| SUN Huai-ying,YU Hui-qun,FAN Gui-sheng and CHEN Li-qiong.Low Latency and High-Reliability Resource Scheduling Method in Big Data Streaming Computing Environment[J].Researches in Medical Education,2017,43(6):855-862. |
| |
| Authors: | SUN Huai-ying YU Hui-qun FAN Gui-sheng and CHEN Li-qiong |
| |
| Institution: | Department of Computer Science and Engineering, East China University of Science and Technology, Shanghai 200237, China;Shanghai Key Laboratory of Computer Software Evaluating and Testing, Shanghai 201112, China,Department of Computer Science and Engineering, East China University of Science and Technology, Shanghai 200237, China,Department of Computer Science and Engineering, East China University of Science and Technology, Shanghai 200237, China and Department of Computer Science and Information Engineering, Shanghai Institute of Technology, Shanghai 200235, China |
| |
| Abstract: | It is quite important for the application of big data to ensure the high-reliability and low-latency of processing the stream data.In this paper,the data stream graph (DSG) is used to describe and model the application process of big data streaming by taking DSG as an extended Petri net.And then,this paper proposes a computing algorithm of resource group reliability via the resource entropy that is based on the average changing rate of CPU utilization.Furthermore,a resource scheduling algorithm,termed as TRS-SCHE,is introduced to attain the high-reliability and low-latency.Finally,through simulation experiments of soda traffic big data analysis,it is shown that compared with the Storm isolated scheduling,the proposed TRS-SCHE scheduling algorithm has more advantages in response time,failure rate and the time complexity. |
| |
| Keywords: | DSG high-reliability low-latency resource entropy response time |
|
| 点击此处可从《医学教育探索》浏览原始摘要信息 |
| 点击此处可从《医学教育探索》下载免费的PDF全文 |
|
