文件存储
文件存储
有孚原力超算平台采用 Lustre 作为后端存储系统,Lustre是一种分布式的、可扩展的、高性能的并行文件系统,能够支持数万客户端、PB级存储容量、数百GB的聚合I/O吞吐,非常适合众多客户端并发进行大文件读写的场合。
在HPC解决方案中,存储方案是关键环节之一,而Lustre并行文件系统则是HPC存储方案中很常见的一种解决方案。
1. 目录结构&权限说明
有孚云超算平台目前已上线一套 Lustre 文件系统,挂载在计算/登录节点的不同目录:/lustre1/software/
、/lustre1/forcestack/
。
1.1. 总目录说明
挂载点 | 子目录 | 功能 | permission |
/lustre1/software | /lustre1/software/mpi | 软件-MPI |
drwxr-xr-x root root |
/lustre1/software | /lustre1/software/app | 软件-行业应用app |
drwxr-xr-x root root |
/lustre1/software | /lustre1/software/compiler | 软件-编译器 |
drwxr-xr-x root root |
/lustre1/software | /lustre1/software/mathlib | 软件-数学库 |
drwxr-xr-x root root |
/lustre1/software | /lustre1/software/modulefile | 软件-模块参数文件 |
drwxr-xr-x root root |
/lustre1/software | /lustre1/software/app-template | 软件-作业模板 |
drwxr-xr-x root root |
/lustre1/forcestack | /lustre1/forcestack/home/ |
用户工作目录 |
drwx------ {user} {user} |
/lustre1/forcestack | /lustre1/forcestack/share/ |
用户共享目录 |
drwx------ {user} {user} |
1.2. /lustre1/software目录说明
类型 | 子目录 | 目录说明 | 示例 |
mpi | /lustre1/software/mpi | /lustre1/software/mpi/{mpi_name}/{mpi_version}/{mpi_version/compiler_version} | /lustre1/software/mpi/intel/2021.1 |
app | /lustre1/software/app | /lustre1/software/app/{app_name}/{app_version}/{mpi_version/compiler_version} | /lustre1/software/app/elmer/8.4/intelmpi-gcc8.3.0 |
compiler | /lustre1/software/compiler | /lustre1/software/compiler/{compiler_name}/{compiler_version}/{mpi_version/compiler_version} | /lustre1/software/compiler/cmake/3.18 |
mathlib | /lustre1/software/mathlib | /lustre1/software/mathlib/{mathlib_name}/{mathlib_version}/{mpi_version/compiler_version} | /lustre1/software/mathlib/netcdf/4.1.3 |
modulefile | /lustre1/software/modulefile | /lustre1/software/modulefile/{mpi/app/compiler/compiler_name}/version/{mpi_version/compiler_version} | /lustre1/software/modulefile/app/elmer/8.4/intelmpi-gcc8.3.0 |
app-template | /lustre1/software/app-template | /lustre1/software/app-template/{app_name} | /lustre1/software/app-template/elmer |
1.3. /lustre1/forcestack目录说明
类型 | 子目录 | 目录说明 | 示例 |
用户工作目录 | /lustre1/forcestack/home/{user_name} | /lustre1/forcestack/home/{user_name}/workspace/{job_name} | /lustre1/forcestack/home/anne/workspace/Abinit_211117094006 |
用户共享目录 | /lustre1/forcestack/share/{user_name} | /lustre1/forcestack/share/{user_name}/{share_name} | /lustre1/forcestack/share/anne/data_1638438760191 |