A Data Deduplication Framework of Disk Images with Adaptive Block Skipping

来源 :计算机科学技术学报(英文版) | 被引量 : 0次 | 上传用户:hdydrd
下载到本地 , 更方便阅读
声明 : 本文档内容版权归属内容提供方 , 如果您对本文有版权争议 , 可与客服联系进行内容授权或下架
论文部分内容阅读
We describe an e?cient and easily applicable data deduplication framework with heuristic prediction based adaptive block skipping for the real-world dataset such as disk images to save deduplication related overheads and improve deduplication throughput with good deduplication e?ciency maintained. Under the framework, deduplication operations are skipped for data chunks determined as likely non-duplicates via heuristic prediction, in conjunction with a hit and matching extension process for duplication identification within skipped blocks and a hysteresis mechanism based hash indexing process to update the hash indices for the re-encountered skipped chunks. For performance evaluation, the proposed framework was integrated and implemented in the existing data domain and sparse indexing deduplication algorithms. The experimental results based on a real-world dataset of 1.0 TB disk images showed that the deduplication related overheads were significantly reduced with adaptive block skipping, leading to a 30%~80%improvement in deduplication throughput when deduplication metadata were stored on the disk for data domain, and 25%~40% RAM space saving with a 15%~20% improvement in deduplication throughput when an in-RAM sparse index was used in sparse indexing. In both cases, the corresponding deduplication ratios reduced were below 5%.
其他文献
近日,在柳州市2019年市政服务政务公开和公共资源交易工作会议上,柳州市行政审批局(以下简称“审批局”)表示继續“提速、增效、降本、惠民和创新”,大力开展“政务服务高质量发展年”,打造“政合你意”2.0版,铸造独具特色的放管服改革“柳州样板”。  据介绍,在过去的2018年里,柳州市政务服务中心窗口(含分中心)政务服务办件总数为18 2.56万件,无超时办件;累计进入柳州市、鹿寨县公共资源交易平台
期刊
该文从挂篮荷载计算、施工流程、支座及临时固结施工、挂篮安装及试验、合拢段施工、模板制作安装、钢筋安装、混凝土的浇筑及养生、测量监控等方面人手,介绍了S226海滨大桥
期刊
头位分娩监测产程中活跃期延长、停滞时有发生,不及时发现、正确处理,会导致新生儿窒息、死产、产后出血等严重后果。现将我院近2年来活跃期停滞病例分析报告如下。1资料与方
该文从挂篮荷载计算、施工流程、支座及临时固结施工、挂篮安装及试验、合拢段施工、模板制作安装、钢筋安装、混凝土的浇筑及养生、测量监控等方面人手,介绍了S226海滨大桥
期刊
患者 ,男 ,35岁。因头痛 2d ,加重昏迷 9h入院。病前曾接触过病羊。体检 :T 39.4℃。深昏迷。瞳孔等大等圆。光反射存在。皮肤有散在出血斑。左腋下淋巴结肿大。实验室结果 :血WBC
我科自2003年9月至2008年12月,分别采用微创胸腔置管引流结合注射白细胞介素(IL)-2、顺铂及胸腔置管引流单一注射顺铂治疗,发现前者疗效优于后者,现报告如下.
We describe a data deduplication system for backup storage of PC disk images, named in-RAM metadata utilizing deduplication (IR-MUD). In-RAM hash granularity ad
随着国内外护理实践的深入和护理理论的不断完善,临床护理工作的重心正向新的方向发展,主要表现为以病人为中心,推行整体护理;以临床路径为手段,实施循证护理.临床路径作为一
在X线照片质量保证及控制系统中,根据胶片及显影液、增感屏的特性参数,确定恰当的曝光量,才能在影像信息的转化过程中充分发挥胶片的最佳性能,保证优质光学影像的形成。在X线照片
该文从挂篮荷载计算、施工流程、支座及临时固结施工、挂篮安装及试验、合拢段施工、模板制作安装、钢筋安装、混凝土的浇筑及养生、测量监控等方面人手,介绍了S226海滨大桥
期刊