A GPU-Accelerated In-Memory Metadata Management Scheme for Large-Scale Parallel File Systems

来源 :计算机科学技术学报(英文版) | 被引量 : 0次 | 上传用户:shenshenxiaomo
下载到本地 , 更方便阅读
声明 : 本文档内容版权归属内容提供方 , 如果您对本文有版权争议 , 可与客服联系进行内容授权或下架
论文部分内容阅读
Driven by the increasing requirements of high-performance computing applications,supercomputers are prone to containing more and more computing nodes.Applications running on such a large-scale computing system are likely to spawn millions of parallel processes,which usually generate a burst of I/O requests,introducing a great challenge into the metadata management of underlying parallel file systems.The traditional method used to overcome such a challenge is adopting multiple metadata servers in the scale-out manner,which will inevitably confront with serious network and consistence problems.This work instead pursues to enhance the metadata performance in the scale-up manner.Specifically,we propose to improve the performance of each individual metadata server by employing GPU to handle metadata requests in parallel.Our proposal designs a novel metadata server architecture,which employs CPU to interact with file system clients,while offloading the computing tasks about metadata into GPU.To take full advantages of the parallelism existing in GPU,we redesign the in-memory data structure for the name space of file systems.The new data structure can perfectly fit to the memory architecture of GPU,and thus helps to exploit the large number of parallel threads within GPU to serve the bursty metadata requests concurrently.We implement a prototype based on BeeGFS and conduct extensive experiments to evaluate our proposal,and the experimental results demonstrate that our GPU-based solution outperforms the CPU-based scheme by more than 50%under typical metadata operations.The superiority is strengthened further on high concurrent scenarios,e.g.,the high-performance computing systems supporting millions of parallel threads.
其他文献
目的探讨超声监测下手风琴技术促进胫骨搬移术后对合端骨愈合的临床效果和影像学表现。方法回顾性分析2018年5月至2019年10月山西医科大学第二医院骨科收治的16例在超声监测下利用手风琴技术促进对合端骨愈合的胫骨搬移术后患者的临床资料。男性14例,女性2例,年龄(45.3±14.3)岁(范围:6~61岁)。在实施骨搬移之前,胫骨骨缺损长度为(6.0±2.6)cm(范围:2.0~12.1 cm)。手风
Non-Volatile Main Memories(NVMMs)have recently emerged as a promising technology for future memory systems.Generally,NVMMs have many desirable properties such a
目的探讨胆管闭锁患儿首次肝移植术中大量出血的相关因素及其对预后的影响。方法回顾性分析2015年1月至2018年12月在天津市第一中心医院儿童器官移植科行肝移植的613例胆管闭锁患儿的临床资料。男270例,女343例;受者年龄为7.4(3.9)个月(范围:3.2~148.4个月);体重为(7.8±3.5)kg(范围:4.0~43.3 kg)。以所有移植患儿的第85分位估计出血量(EBL)(74 ml
Genomic sequence alignment is the most critical and time-consuming step in genomic analysis.Alignment al-gorithms generally follow a seed-and-extend model.Accel
Iterative control structures allow the repeated execution of tasks,activities or sub-processes according to the given conditions in a process model.Iterative co
Communication and coordination between open source software(OSS)developers who do not work physically in the same location have always been the challenging issu
The short-range pair interaction consumes most of the CPU time in molecular dynamics(MD)simulations.The inherent computation sparsity makes it challenging to ac
Persistent indexing structures are proposed in response to emerging non-volatile memory(NVM)to provide high performance yet durable indexes.However,due to the l
A universal and general quantum simultaneous secret distribution(QSSD)protocol is put forward based on the properties of the one-dimensional high-level cluster
Accesses Per Cycle(APC),Concurrent Average Memory Access Time(C-AMAT),and Layered Performance Matching(LPM)are three memory performance models that consider bot