Storage

This page briefly describes the storage options that are available to you, who supports them, and how you can use best use them as part of your research computing.  Please see the CADRE storage page for more information.

In all examples, substitute your actual login for mst3k.

Home Directory

Each user is provided 50GB of free home directory space.  Snapshots are kept for three weeks.  It is currently not available as a remote mount to Windows or Mac, but can be accessed through Globus

Users are encouraged not to hard-code home-directory paths into their scripts, but rather to use ${HOME}/mydir or ~mst3k.  However, for most users /home/mst3k is an appropriate path.

"Tiny"

This space currently corresponds to the ITS Home Directory Service.  It can be accessed as /tiny/mst3k

This space can be used as an additional backup for critical files.  It can also be mounted as a remote drive on Windows, OSX, and Linux using the ITS HDS application ("J drive" on Windows).  The major limitation is that it is provides only 4GB of free space.

Scratch Storage

All Rivanna nodes can access the /scratch storage system. The scratch space is provided by a high-speed Lustre parallel filesystem.

Each user is granted 10TB of free space as /scratch/mst3k, but it is intended as temporary storage for active work. It is reliable, but it is not backed up. A disadvantage to Lustre is that its performance is impacted negatively by a large number, not just size, of files, so in addition to the 10TB limit there is a per-user limit of 350,000 files. Users who exceed either of these limits will not be able to submit new jobs until the excess has been removed.

The Lustre Mounted storage is managed by the research computing support group. if you have any questions or require assistance with /scratch, please contact us. If you wish to request a very large temporary increase in your /scratch quota, you can  submit a /scratch supplemental request.

Leased Storage

Storage can be leased from ITS and made available to Rivanna. ITS can provision a variety of options at different price points depending on your needs. Enterprise storage with full backups is most expensive. The most economical storage is Value storage, which is neither backed up nor automatically replicated. Please see ITS hosting for details.

Value storage can be slow; If your jobs do lots of IO or require long and big reads/writes, then your job performance may be poor.  Copy your files to /scratch for your runs and transfer your results from /scratch back to Value storage.

ITS leased storage is not managed by the research computing group.  Problems should be submitted to ITS through their service portal.

Project Storage

Project storage is a higher-performance leased storage, with snapshots.  This tier can be requested by submitting this form.

UVA Box

All UVA users have free access to 1TB of storage at UVA Box, a large cloud-based storage container. Using FastX to access Rivanna, you can access your UVA Box account using Firefox, and then directly transfer data to and from your box account. You can just as easily access the same box account from home, or on the go: wherever you have Internet access. UVA Box  transfers are very slow and running jobs cannot directly read or write data to or from your UVA Box space, but it can be useful for archival purposes. 

Please contact the ITS help desk if you have any questions or require assistance with your UVA Box account.