HPC Storage, File Systems

Overview

Talon 3 has a variety of file systems. It is crucial that you understand the proper use of these file systems for best performance and stewardship of computational resources. Misuse of the file systems could mean the termination of your jobs or loss of your data.

Summary of File Systems

Name Path Type
home /home/$USER ext4
scratch2 /storage/scratch2/$USER Lustre

 

Details of File Systems

Home directory When you log in, your home directory (aka $HOME) is set to your EUID as such /home/euid123.  This ext4 filesystem is local only to Talon 3 login and all home directories are made available to each compute node, via NFS mount. Quotas are set in /home, use the "quota" command to check your quota.  Home directories are for storing, input, output, codes, scripts, ... and should never be used for runtime temporary/scratch files, as this causes undue traffic and slows the operation of this filesystem. For more on file permissions, see the online UNIX manuals (aka man page) on chown, chgrp, chmod.

Scratch2 directory: For storage, the HPC Team has deployed an updated high-speed parallel filesystem named scratch2. It is running Lustre on a DDN SFA7700X storage appliance. This filesystem has 1.4PB total available and can sustain speeds of up to 10GB/s over FDR Infiniband. Each compute node has the file system mounted as /storage/scratch2. The Scratch2 filesystem should be used when running your jobs. Files in this filesystem are subject to being removed after each run, so please copy any data you wish to save back to your home directory. Additionally, each PI research group can request a shared file space where members of the same PI group can access. If your research group requires a shared access directory, send a ticket to hpc-admin@unt.edu.