Research on data pre-deployment in information service flow of digital ocean cloud computing

来源 :Acta Oceanologica Sinica | 被引量 : 0次 | 上传用户:wjbbio
下载到本地 , 更方便阅读
声明 : 本文档内容版权归属内容提供方 , 如果您对本文有版权争议 , 可与客服联系进行内容授权或下架
论文部分内容阅读
Data pre-deployment in the HDFS(Hadoop distributed file systems) is more complicated than that in traditional file systems. There are many key issues need to be addressed, such as determining the target location of the data prefetching, the amount of data to be prefetched, the balance between data prefetching services and normal data accesses. Aiming to solve these problems, we employ the characteristics of digital ocean information service flows and propose a deployment scheme which combines input data prefetching with output data oriented storage strategies. The method achieves the parallelism of data preparation and data processing, thereby massively reducing I/O time cost of digital ocean cloud computing platforms when processing multi-source information synergistic tasks. The experimental results show that the scheme has a higher degree of parallelism than traditional Hadoop mechanisms, shortens the waiting time of a running service node, and significantly reduces data access conflicts. Data pre-deployment in the HDFS (Hadoop distributed file systems) is more complicated than that in traditional file systems. There are many key issues need to be addressed, such as determining the target location of the data prefetching, the amount of data to be prefetched, the balance between data prefetching services and normal data accesses. Aiming to solve these problems, we employ the characteristics of digital ocean information service flows and propose a deployment scheme. parallelism of data preparation and data processing, thereby massively reducing I / O time cost of digital ocean cloud computing platforms when processing multi-source information synergistic tasks. The experimental results show the the scheme has a higher degree of parallelism than traditional Hadoop mechanisms, shortens the waiting time of a running service node, and significantly reduces data access conf licts.
其他文献
通过在几条公路边坡防护工程中应用香根草的实际经验 ,对在不同条件下所采用的设计规格不同、植物品种配置不同以及施工时间不同 ,所产生的系统功能效果进行分析。同时对公路
用10%阿维·甲氧虫酰肼防治稻纵卷叶螟药效试验。结果表明:浓度为60mL/667m2防治稻纵卷叶螟的效果优于浓度为40mL和50mL/667m2,但效果更佳的为20%氯虫苯甲酰胺。 Efficacy T
Background Multiple osteochondromas (MO), an inherited autosomal dominant disorder, is characterized by the presence of multiple exostoses on the long bones. M
经济的发展依赖于交通运输的发展,内河水路运输是我县交通运输方式中不可缺少的部分,它具有投资少,成本低,运量大,安全系数高和综合运输等特点。我县内河水路运输中,长江流域
过去30 a,田间微集雨技术逐渐发展成为黄土高原雨养农业区的主要耕作技术.自上世纪八十年代以来,不同田间微集雨及覆盖(地膜、砂石和秸秆)栽培技术在黄土高原不断更新换代,先
试验旨在探讨微生物对肉鸭肝脏、肌肉组织中黄曲霉毒素B1(aflatoxinB1, AFB1)残留的影响.选用健康、体重相近的1日龄樱桃谷肉鸭192只(雌、雄混养),适应环境1周后,随机分为6个
采用3个肉鸡试验测定高蛋白豆粕(SBM-HP)、低寡糖豆粕(SBM-LO)和常规豆粕(SBM-CV)的饲用价值.这3种豆粕(SBM)的粗蛋白含量(CP)分别为54.9%、53.6%和47.5%.①3种豆粕的氨基酸(
目的:探讨养老院内老年人的营养状况及相关影响因素,为改善老年人的营养状况提供依据。方法2013年4月采用整群随机抽样法,随机抽取上海市某远郊地区2个养老院进行调查,以养老院中
选取低浓度系列平衡液进行等温吸附解吸试验,并结合田间试验的效果,研究了不同水稻土对硅的吸附解吸特征及其与土壤理化性质水稻土供硅能力之间的关系。结果表明:在低浓度梯
是环境工程学科的一门核心课程,不但概念公式繁多,而且还有大量的实物图例以及工艺流程图.本文以Macromedia Authorware 5.0为开发工具,开发了多媒体CAI课件.本文对课件的框