Metadata Feedback and Utilization for Data Deduplication Across WAN

来源 :计算机科学技术学报(英文版) | 被引量 : 0次 | 上传用户:vicovicovicovico
下载到本地 , 更方便阅读
声明 : 本文档内容版权归属内容提供方 , 如果您对本文有版权争议 , 可与客服联系进行内容授权或下架
论文部分内容阅读
Data deduplication for file communication across wide area network (WAN) in the applications such as file synchronization and mirroring of cloud environments usually achieves significant bandwidth saving at the cost of significant time overheads of data deduplication. The time overheads include the time required for data deduplication at two geographi-cally distributed nodes (e.g., disk access bottleneck) and the duplication query/answer operations between the sender and the receiver, since each query or answer introduces at least one round-trip time (RTT) of latency. In this paper, we present a data deduplication system across WAN with metadata feedback and metadata utilization (MFMU), in order to hess the data deduplication related time overheads. In the proposed MFMU system, selective metadata feedbacks from the receiver to the sender are introduced to reduce the number of duplication query/answer operations. In addition, to hess the metadata related disk I/O operations at the receiver, as well as the bandwidth overhead introduced by the metadata feedbacks, a hysteresis hash re-chunking mechanism based metadata utilization component is introduced. Our experimental results demonstrated that MFMU achieved an average of 20%~40% deduplication acceleration with the bandwidth saving ratio not reduced by the metadata feedbacks, as compared with the“baseline”content defined chunking (CDC) used in LBFS (Low-bandwith Network File system) and exiting state-of-the-art Bimodal chunking algorithms based data deduplication solutions.
其他文献
AIM:To clarify the significance of JC virus(JCV)T-antigen (T-Ag)expression in human gastric cancer. METHODS:We investigated the relationship between T-Ag detect
Acute myelogenous leukemia (AML) can involve the gastrointestinal tract but rarely involves the appendix.We report a male patient who had 1 year partial remissi
AIM: To study the relationship between the polymorphismsin some cytokines and the outcome of hepatitis B virus (HBV) and hepatitis C virus (HCV) infection.METHO
大银鱼以其极高的营养价 值和经济价值成为我国重要经 济鱼类之一,并在全国适宜水 域得到普遍移植,人工繁殖技 术也日趋完善。但受性成熟自 然规律和产卵场及产卵高峰期 监测技
由江苏省海洋水产研究所承担的2000年省水产技术更新工程项目“海洋池塘循环水高效益养殖技术”于2000年春季在该所海水增养殖技术及种苗中心实施,并已超额完成计划规定的有关技术经济
大西洋鲑(图1)、大鳞鲑(图2)均为鲑科鱼类,有洄游型和陆封型。大西洋鲑历史上广布于大西洋北部、北美南部安哥拉湾到安大略湖一带的淡水水域、俄罗斯的白海到地中海沿岸的葡萄牙。陆
稻田养殖田螺是在不影响粮食产量的基础上,增加农民收入,发挥水田综合效益的好举措。1999-2000年,我站在洋中镇进行了200亩的稻田养殖田螺试验,获得亩产田螺140公斤,亩增加经济收入600元的好成绩,现将
2000年,我县第一批鲤鱼春孵,是十年来孵化率最低的一年,同时孵化的三个场点,最低的为20%,高的也只达30%,而历年春孵,最低也在70%以上,其原因是连续低温阴雨造成,这种天气可说是鲤鱼孵化的灾害性天气