1引言随着大数据时代的发展,数据量正在爆炸式增长,数据更新变化也在时刻进行~[1]。调查发现云端数据中心有60%以上数据是冗余的,这就为数据同步提出了巨大挑战。针对云环境下集群分布式存储的全局重复数据删除,存在着数据块索引磁盘瓶颈和存储节点信息孤岛两大困难:(1)数据块索引磁盘瓶颈:在存储服务器节点的磁盘上建立一个数据块索引序列,完成集群内数据存储节点的重复数据删除。(2)重复数据删除节点信息孤岛:针对云环境下集 1 Introduction With the development of the era of big data, the amount of data is exploding, data changes are changing at the moment ~ [1]. The survey found that over 60% of the data in the cloud data center is redundant, posing a huge challenge for data synchronization. For global data deduplication of cluster distributed storage in cloud environment, there are two difficulties of data block index disk bottleneck and storage node information silos: (1) Data block index disk bottleneck: Establish a data block on the disk of storage server node Index sequence to complete deduplication of data storage nodes in the cluster. (2) deduplication node information island: set for cloud environment